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1.0  Introduction  and  Study  Overview 

As  its  name  suggests,  the  Maximum  Entropy  /Optimal  Projection  (MEOP)  theory  of  control 
design  for  large  space  systems  represents  the  synthesis  of  two  distinct  and  novel  ideas:  (1)  min¬ 
imum  information  stochastic  modeling  of  parameter  uncertainties  (to  characterize  the  inevitable 
tradeoff  between  robustness  and  performance)  and  (2)  optimal  reduced-order  compensator  design 
for  a  given  high-order  plant  (to  optimally  quantify  the  tradeoff  between  controller  complexity  and 
performance).  A  previous  AFOSR-funded  study  (contract  no.  F49620-84-C-0015)  consolidated 
MEOP  theory  developments  and  successfully  demonstrated  the  theory  on  a  variety  of  flexible  space 
structure  models. 

It  is  now  possible  to  extend  the  basic  MEOP  theory  and  design  capability  to  handle  an  even 
larger  class  of  structural  concepts.  In  particular,  the  sheer  size,  or  dimensionality,  of  proposed 
flight  structures  (such  as  Space  Station)  necessitates  what  may  be  called  decentralized  analysis 
and  design.  In  brief,  this  terminology  refers  to  procedures  which  treat  portions  of  the  system 
individually  and  then  combine  the  results.  Often  the  need  for  such  analysis  arises  from  such  basic 
constraints  as  computer  capacity,  i.e.,  the  model  may  simply  be  too  large  to  be  manipulated  by  the 
computer  at  one  time. 

Our  thinking  concerning  decentralized  analysis  and  design  is  closely  related  to  the  current  lit¬ 
erature  on  large  scale  systems.  Our  goal  is  thus  to  go  beyond  previous  work  by  using  the  MEOP 
theory  to  quantify  uncertain  interactions  among  subsystems,  thus  providing  an  informational  sys¬ 
tem  partitioning.  A  major  goal  in  this  regard  is  to  utilize  our  theory  to  extend  the  applicability  of 
the  concept  of  connective  stability  to  complex,  multibody  spacecraft. 

In  practice,  a  direct  consequence  of  the  physical  size  and  physical  complexity  of  proposed 
spacecraft  imposes  severe  constraints  on  the  communication  links  between  sensors,  processors  and 
actuators.  Relevant  issues  include  cabling  mass  and  RF  shielding  problems  along  with  reliabil¬ 
ity  concerns.  This  leads  to  consideration  of  multiple  sensor/processor/actuator  subcontrollers  or 
substations  on  the  spacecraft  without  real-time  intercommunication.  Although  the  processors  do 
not  directly  exchange  data,  preflight  design  of  their  software  must,  of  course,  account  for  complex 
operational  interactions  among  subcontrollers  via  the  structural  response. 

The  design  of  such  a  decentralized  architecture  or  implementation  is  clearly  a  nontrivial  task 
and  can  be  thought  of  as  involving  two  interrelated  steps: 
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1.  Determination  of  the  control-system  architecture  including  the  number  of  substations  and 
the  assignments  of  sensors  and  actuators  to  particular  substations;  and 

2.  For  a  given  architecture,  design  of  the  processor  software  for  each  subcontroller. 

The  aims  of  the  present  study  are  to  extend  MEOP  to  address  both  of  the  above  items.  Indeed, 
because  maximum  entropy  modeling  quantifies  uncertainty  (i.e.,  lack  of  knowledge)  it  is  possible 
to  directly  include  informational  aspects  in  the  system  model.  One  goal  is  to  quantify  the  degree 
of  suboptimality  resulting  from  interaction  uncertainties  and  alternative  controller  architectures. 
Once  a  particular  architecture  is  selected,  the  design  of  each  subcontroller  often  requires  iterative 
solution  of  high-dimensional  design  synthesis  equations.  A  second  major  goal  is  thus  to  evolve 
efficient  approaches  to  the  solution  of  the  MEOP  design  equations  for  optimal,  decentralized  control. 

1.1  Objectives 

The  specific  tasks  required  to  accomplish  the  goals  of  this  project  are  discussed  in  detail  within 
the  original  technical  proposal  and  are  summarized  as  follows: 

Task  1: 

Undertake  rigorous  extensions  of  the  MEOP  design  equations  to  the  case  of  distributed  (decentral¬ 
ized)  controller  architecture  in  a  variety  of  settings.  These  developments  include: 

1.1  Extension  of  the  continuous-time  MEOP  equations  to  the  decentralized  case. 

1.2  Derivation  of  the  MEOP  design  equations  for  decentralized  discrete-time  control  of  discrete- 
time  systems. 

1.3  Extension  of  the  MEOP  design  equations  to  a  hierarchical  controller  architecture. 

Task  2: 

Develop  methods  for  determining  performance  degradation  due  to  uncertainty  so  as  to  evaluate 
the  performance  of  different  decentralized  architectures  with  controllers  obtained  via  the  design 
equations  derived  in  Task  1.  In  particular: 

2.1  Derive  methods  for  bounding  the  degree  of  suboptimality  resulting  from  decentralized 
design  and  decentralized  implementation. 

2.2  Evolve  effective  methods  for  deriving  uncertainty  bounds  which  imply  connective  stability 


« 


« 


« 


i 
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for  the  overall  system. 


Task  3: 

Verify  the  analysis  carried  out  in  Task  2  and  develop  solution  techniques  for  the  decentralized  form 
of  the  MEOP  design  equations.  The  following  sequence  of  developments  was  carried  out: 

3.1  Develop  more  efficient  techniques  for  solving  the  MEOP  centralized  control  design  equa¬ 
tions.  In  particular,  apply  topological  degree  theory  to  elucidate  the  solution  set  and  es¬ 
tablish  the  globally  optimal  solution.  Then  develop  homotopy  methods  for  highly  efficient 
numerical  solution  of  the  centralized  design  equations. 

3.2  Exploit  the  developments  of  3.1  to  analyze  the  existence,  uniqueness,  and  global  optimality 
of  solutions  to  the  decentralized  MEOP  design  equations  derived  in  Task  1.  Utilize  the 
homotopy  algorithms  derived  in  3.1  to  establish  a  convergent  solution  procedure  for  the 
decentralized  design  equations. 

Task  4: 

Apply  the  various  decentralized  extensions  of  MEOP  to  realistic  design  problems.  For  each  of  the 
selected  design  examples  the  following  subtasks  encompass  the  desired  goals: 

4.1  Generate  detailed  state-space  model,  define  uncertainties,  define  sensor/actuator  number, 
type  and  placement,  and  assign  disturbance  spectrum.  Use  system  model  to  perform  cen- 
tralized  control-trs^^off  studies  Such  designs  may  utilize  decentralized  design  techniques. 

4.2  Using  the  centralized  tradeoff  studies  as  baseline,  determine  decentralized /hierarchical  im¬ 
plementation  architectures  based  upon  uncertainty  patterns,  physical  constraints  and  pro¬ 
cessing  requirements.  For  each  design  assess  the  degree  of  suboptimality  resulting  from  the 
loss  of  centralization. 

1.2  Outline  of  Program  Accomplishments 

In  this  section,  we  briefly  summarize  the  results  obtained  under  the  tasks  listed  above.  Further 
details  are  given  in  Sections  2.0  through  5.0  and  the  Appendices. 

Since  developments  under  Task  2  are  not  only  of  fundamental  significance  to  MEOP  design 
but  also  represent  the  discovery  of  entirely  new  design  analysis  tools,  these  accomplishments  axe 
discussed  first  in  this  report. 


The  essential  problem  to  be  addressed  in  subtasks  2.1  and  2.2  is  the  determination  of  non- 
conservative  bounds  on  system  performance  degradation  due  to  uncertainties  and/or  subsystem 
interactions.  Note  that  once  performance  degradation  (e.g.,  line-of-sight  error,  surface  shape  er¬ 
rors)  is  characterized,  so  is  robust  stability.  Thus  both  2.2  and  2.3  are  handled  by  developing  a 
suitable  performance  robustness  analysis.  This  has  been  accomplished  by  the  development  of  a 
new  robustness  analysis  tool,  namely,  Majorant  Robustness  Analysis  (MRA).  Based  upon  the  work 
of  Ostrowski  and  Dahlquist  on  matrix  majorants,  MRA  determines  bounds  on  the  degradation  of 
system  performance  due  to  unstructured  or  parametrically  structured  uncertainties  and  bounded 
subsystem  dynamics.  Since  the  basic  development  is  carried  out  in  a  general  operator  setting, 
MRA  can  be  applied  within  both  frequency-domain /input-output  and  time-domain /state-space 
descriptions.  In  the  frequency  domain/input-output  setting  MRA  generalizes  previous  robustness 
results  (e.g.,  singular-value  analysis),  while  in  the  state-space  setting  it  is  fully  compatible  with 
MEOP  design  synthesis.  MRA  thus  provides  a  design  analysts  tool  which  nicely  complements  our 
design  synthesis  theory.  Moreover,  MRA  reveals  a  direct  link  between  the  MEOP  stochastic  mod¬ 
eling  and  design  formulation  and  a  deterministic  bound  for  robust  performance,  thereby  immensely 
strengthening  the  foundations  of  the  Maximum  Entropy  modeling  approach.  Section  2.0  outlines 
the  theory  of  MRA  and  illustrates  its  application  to  statistical  response,  frequency  domain  analysis, 
and,  finally,  time-domain  analysis  of  system  transient  response. 

With  the  development  of  MRA  as  a  rigorous  design  analysis  tool,  one  is  in  position  to  formulate 
the  problem  of  robust  decentralized  control  as  a  well-posed  optimization  problem.  The  robust 
optimization  problem  reduces  to  the  optimization  of  controller  gains  for  fixed-structure  controllers 
under  a  Maximum  Entropy  stochastic  system  model  (or,  equivalently,  under  a  MRA  model).  The 
application  of  optimization  theory  to  the  theoretical  solution  of  these  fixed-structure  optimization 
problems  (i.e.,  the  derivation  of  optimality  conditions)  is  the  essence  of  Task  1  and  has  been  fully 
carried  out.  More  details  on  the  resulting  MEOP  design  synthesis  equations  for  decentralized  and 
hierarchical  controllers  is  given  in  Section  3.0. 

The  MEOP  design  equations  derived  under  Task  1  show  that  the  optimality  conditions  for 
robust  decentralized/hierarchical  controllers  can  be  decomposed  into  a  sequence  of  design  equations 
involving  four  nonlinear  matrix  equations  for  each  control  substation  or  coordinator.  Each  set 
of  four  equations  has  the  same  fundamental  structure  as  the  four  MEOP  design  equations  for 
centralized  control  design.  This  surprising  decomposition  of  the  structure  of  the  decentralized 
hierarchical  MEOP  equations  immediately  suggests  an  iterative  solution  procedure  which  reduces 
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the  overall  problem  to  the  sequential  solution  of  standard  MEOP  design  equations  pertaining  to 
each  subcontroller  and  /or  coordinator. 

The  above  observations  have  gTeatly  simplified  the  development  of  efficient  solution  algorithms 
under  Task  3.  Since,  however,  each  subcontroller  problem  may  be  of  high  dimension  and  the 
number  of  subsystems  may  often  be  considerable,  it  was  recognized  that  an  order  of  magnitude 
improvement  was  needed  for  the  efficiency  of  the  MEOP  solution  algorithm.  Thus,  we  proceeded  in 
two  stages:  Develop  greatly  improved  solution  techniques  for  the  MEOP  centralized  control  design 
(Task  3.1),  then  exploit  the  results  for  solving  the  decentralized /hierarchical  design  equations  (Task 
3.2). 

Under  Task  3.1,  S.  Richter  has  developed  and  successfully  tested  a  homotopic  continuation  algo¬ 
rithm  for  solving  the  basic  MEOP  design  equations.  In  place  of  solving  four  (n  xn)(n  =  dimension 
of  the  plant)  nonlinear  matrix  equations  as  in  previously  developed  algorithms,  Richter’s  method 
reduces  the  problem  to  solving  four  nc  x  n  (ne  =  dimension  of  compensator)  linear  equations  for  a 
modest  number  of  continuations  steps.  The  algorithm  converges  to  machine  accuracy,  and  for  nc 
small  actually  entails  less  computation  than  is  required  for  the  standard  Riccati  solutions  involved 
in  the  full-order  compensator.  Moreover,  using  the  continuation  approach  together  with  topologi¬ 
cal  degree  theory,  Richter  has  succeeded  in  resolving  many  heretofore  intractable  issues  connected 
with  multiplicity  of  solutions  and  convergence  to  the  global  minimum.  These  results  essentially 
complete  the  theoretical  foundation  of  the  optimal  projection  theory  of  fixed-order  dynamic  com¬ 
pensator  design.  It  should  also  be  noted  that  in  a  broader  context,  these  results  illustrate  a  new 
general  approach  to  nonconvex  optimization  problems.  Further  details  on  the  iterative  approach 
to  decentralized  design  and  on  Richter’s  algorithm  are  given  in  Section  4.0. 

Finally,  both  dynamic  modeling  and  determination  of  baseline  centralized  control  designs  have 
been  completed  for  a  variety  of  realistic  example  problems  thus  completing  Task  4.  These  are 
discussed  in  numerous  publications  and  are  highlighted  in  the  body  of  this  report. 
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SECTION  2.0 

Performance  Degradation 
Due  to  Uncertainties  and  Subsystem  Interactions 
Via  Majorant  Analysis 


2.0  Performance  Degradation  Due  to  Uncertainties  and  Subsystem  Interactions 

Via  Majorant  Analysis 

The  problem  addressed  here  is  the  determination  of  bounds  on  the  degradation  of  system  per¬ 
formance  due  to  uncertainties  and/or  unforeseen  and  imperfectly  modeled  subsystem  interactions. 
Such  bounding  techniques  represent  a  fundamental  systems  analysis  tool  that  is  indispensable  for 
further  elucidation  of  decentralized  controller  architectures  and  robust  design. 

Extensive  work  has  been  carried  out  in  the  area  of  frequency-domain  analysis  of  robust  stability 
giving  rise  to  the  H-infinity  theory  of  robustness  characterization  and  robust  design  [2. 1-2. 5]. 
However,  although  the  if -infinity  world-view  is  a  beautiful  and  compelling  theory  within  its  proper 
province,  its  fundamental  assumptions  render  it  inapplicable  to  structural  vibration  control  which 
involves  parametric  and  often  nondestabilizing  open-loop  uncertainties.  A  principal  difficulty  is  the 
conservatism  of  ^-infinity  robustness  characterizations.  A  stability  robustness  analysis  technique 
is  called  conservative  if  the  predicted  set  of  nondestabilizing  perturbations  is  a  proper  subset  of  the 
actual  set  of  nondestabilizing  perturbations.  Note  that  conservatism  jointly  depends  upon  both 
the  definition  of  admissible  perturbation  classes  and  the  robustness  analysis  technique. 

The  well-known  conservatism  of  If -infinity  theory  does  not  arise  because  it  operates  in  the 
frequency  domain,  per  se,  or  because  the  infinity  norm  is  employed,  but  rather  because  of  the 
crudeness  of  //-infinity  bounds.  What  is  the  fundamental  source  of  this  crudeness?  Possibly  this 
arises  because  the  fundamental  intent  of  H- infinity  development  was  the  extension  of  classical 
control  design  concepts  to  the  multivariable  case  per  se  rather  than  specifically  for  the  problem  at 
hand. 

For  example,  in  keeping  with  classical  ideas,  there  has  been  widespread  insistence  upon  couching 
all  questions  of  performance  and  uncertainty  in  terms  of  simplistic  (albeit  traditional)  unity  gain 
feedback  diagrams.  Thus,  singular  value  developments  have  lumped  uncertainty  in  a  single  block 
thereby  obscuring  the  often  complex  structure  of  modeling  error.  Moreover,  this  feedback  paradigm 
is  maintained  even  for  structured  uncertainty  approaches  [2.6]. 

To  achieve  a  less  confining  point  of  view,  the  first  step  is  to  represent  uncertain  systems  by 
means  of  a  large-scale  system  input-output  formulation  as  depicted  in  Figure  2.0-1. 

Referring  to  Figure  2.0-1,  the  overall  system  is  represented  by  interconnected  subsystems  un¬ 
dergoing  interactions.  The  subsystems,  characterized  by  the  operators  G*  (k  =  1, . . . ,  r),  represent 
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the  known  dynamics  of  the  system  while  the  subsystem  interactions,  given  by  the  operators  H kj, 
correspond  to  uncertainties.  Note  that  the  partitioned  off-block-diagonal  operator  H  is  stipulated 
to  belong  to  some  compact  arcwise  connected  set  M .  The  set  M  specifies  both  the  character  and 
extent  of  dynamical  uncertainties. 

The  motivation  for  the  above  input-output  formulation  within  the  context  of  large-scale  systems 
is  obvious.  But  in  addition,  thanks  to  the  Dynamic  Inclusion  Principle  and  related  ideas  elaborated 
by  Siljak  and  his  co-workers  [2. 7, 2.8]  the  representation  of  Figure  2.0-1  is  also  suitable  for  parametric 
perturbations  in  monolithic  systems,  i.e.,  systems  without  explicit  interconnections. 

The  problem  now  addressed  is  how  to  bound  the  degradation  of  the  system  output  vector  y  or 
the  prediction  y  —  yo  in  the  presence  of  the  uncertainties.  To  give  this  problem  mathematical  form, 
we  must  use  the  block-matrix  results  of  Ostrowski  [2.9]  and  define  the  block-Lp  norm  matrix  of  a 
partitioned  operator  M  and  the  block-norm  matrix  of  a  partitioned  matrix  M  as  in  the  top  half  of 
Figure  2.0-2.  With  these  definitions,  the  principal  problem  is  to  bound  the  block-norm  vector  of 
the  system  output  y  over  all  variations  of  the  uncertain  perturbations,  i.e.,  |y|j,  as  H  varies  over 
the  whole  set  )i .  Bounding  off-nominal  prediction  errors  is  handled  similarly  and  so  will  not  be 
given  separate  treatment  here. 

Referring  again  to  Figure  2.0-2,  it  is  evident  that  a  suitable  bound  for  |y|t  takes  the  form  of  a 
nonnegative  matrix  (i.e.,  a  matrix  whose  elements  are  nonnegative)  £  multiplied  by  the  block-norm 
vector  of  the  nominal  output.  Note  that  the  double  inequality  sign  relating  two  matrices  indicates 
element-by-element  inequality.  The  “gain  matrix”  t  is  just  a  nonnegative  bound  on  the  worst-case 
value  of  the  block-Z/p  norm  matrix  of  the  output  gain  operator  £,.  Note  that,  in  essence,  t  maps  the 
nominal  output  into  the  actual  output  as  corrupted  by  uncertain  interactions.  In  the  following,  we 
focus  on  bounding  the  gain  operator.  Note  (from  the  bottom  of  Figure  2.0-2)  that  this  formulation 
gives  rise  to  a  clew  definition  of  conservatism.  Note  also  that  the  existence  of  a  finite  bound  C[)i) 
implies  input-output  stability  (see  [2.10]).  Thus  robust  stability  and  performance  degradation  can 
be  handled  by  one  and  the  same  theoretical  apparatus. 

Now,  the  above  articulation  of  uncertainties  into  numerous  interactions  permits  more  finely 
articulated  methods  of  computing  bounds  beyond  singular  value  analysis,  namely,  methods  associ¬ 
ated  with  the  majorant  analysis  of  Dahlquist  [2.11].  Following  Dahlquist,  we  define  the  majorant 
and  minorant  matrices  of  a  partitioned  matrix  or  operator  as  in  the  top  portion  of  Figure  2.0-3. 
The  inequalities  shown  in  the  center  of  the  figure  follow  directly  from  the  definitions  and  indicate 
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Figure  2.0-3.  Matrix  Majorants  and  Minorants 


that  the  majorant  and  minorant  are  matrix  generalizations  of  the  maximum  and  minimum  singular 
values,  respectively.  Moreover,  these  inequalities  can  be  very  efficiently  used  to  bound  the  block- Lp 
norm  matrix  of  the  output  gain  operator.  In  fact,  what  we  seek  is  merely  some  majorant  of  the 
gain  operator. 

Figure  2.0-4  shows  a  simple  example  of  how  the  inequalities  of  Figure  2.0-3  can  be  used  to 
derive  such  a  majorant  for  the  gain  operator,  starting  from  the  defining  relation 

(/  +  GH)C  =  I 

for  t  given  in  Figure  2.0-2.  The  result  obtained  in  Figure  2.0-4,  namely: 

\c\t  <<  t 

{I  -  GH)L  =  Ir 

is,  in  fact,  the  crudest  possible  majorant  bound  and  is  equivalent  to  the  small  gain  theorem  for 
Lp  input-output  stability  of  a  large  scale-system  (2.10).  When  there  is  only  one  system  block,  this 
further  reduces  the  singular-value  bound  as  a  particular  special  case. 

But  the  uncertain  subsystem  interaction  format  (introduced  in  Figure  2.0-1)  in  conjunction 
with  majorant  analysis  gives  an  almost  unlimited  potential  for  formulating  sharper  bounds.  Using 
a  process  of  operator  iteration,  one  can  obtain  the  results  displayed  in  the  top  half  of  Figure  2.0- 
5.  Here  we  have  a  hierarchy  of  output  bounds,  where  each  successive  member  of  the  hierarchy 
requires  more  and  more  information  but  is  less  and  less  conservative  (with  respect  to  the  set  U). 
For  the  results  shown  in  Figure  2.0-5,  the  sequence  of  bounds  approaches  the  least  upper  bound 
under  a  norm-bounded  uncertainty  set,  i.e.,  for  this  set  M  the  hierarchy  is  nonconservative  in  the 
limit!  Note  also  that,  because  we  work  in  an  operator  setting,  distinctions  between  the  time  and 
frequency  domains  are  blurred.  It  is  parochial  to  assert  that  only  frequency-domain  or  time-domain 
methods  must  be  used.  What’s  needed  is  easy  and  fluent  translation  between  the  frequency  and 
time  domains  as  provided  here.  Furthermore,  the  computational  advantage  of  this  kind  of  hierarchy 
is  that  each  bound  requires  only  the  inversion  of  an  M-matrix.  This  is  quite  straightforward  and 
nicely  tractable,  even  for  many  subsystems,  since  it  involves  computing  a  monotonically  increasing 
sequence  where  each  iteration  involves  an  addition  and  a  multiplication  of  low-order  matrices. 
Figure  2.0-6  summarizes  the  relevant  facts  on  the  solution  of  majorant  equations.  One  has  only 
to  contrast  the  simplicity  of  these  results  with  the  difficulties  of  the  p-function  computation  [2.12] 
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Figure  2.0-4.  Example  of  Bound  Derivation 
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Figure  2.0-5.  Hierarchy  of  Lp  Output  Bounds 
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All  majorant  bounos  involve  equations  of  the  form: 

(It-B)L  =  C 
C,  E  «  R*Xt 

*  L  e  R*xr  exists  iff  (I-B)  is  a  nonsingular  K-matrix 

*  L  e  R*xr  exists  iff  the  sequence: 
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{{B}  *  diagonal  part  of  B 
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converges.  If  sof  L  *  liro 

n-»«o 

*  L  €  R*xr  exists  iff  the  sequence: 

Aq  *  (I-{Bi)'1<E>r  S0  =  I  +  A0 
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converges.  If  so: 

L  «  liro  Sk(I-{B})“;lC 
k-ne 

(nth  iterate  *  2n  simple  iterations) 

Figure  2.0-6.  Solution  of  M-Matrix  Equations 
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to  appreciate  the  [. ower  of  the  “uncertain  subsystem”  representation  of  Figure  2.0-1  and  its  allied 
bounding  technique,  majorant  analysis. 

The  above  discussion  has  set  forth  the  general  development  of  majorant  robustness  analysis 
within  an  operator  setting  which  employs  Lp  norms  to  describe  the  “size”  of  subsystem  outputs. 
For  systems  with  stochastic  inputs  and  time  independent  parameter  uncertainties,  the  main  lines  of 
development  are  analogous.  However,  in  this  case  one  needs  to  work  with  the  Lyapunov  equation 
for  the  steady-state  second-moment  matrix  of  response  and  then  derive  majorant  bounds  for  the 
block-norm  matrix  of  the  second  moment.  The  general  setup  for  undertaking  majorant  analysis  for 
the  parametrically  uncertain  stochastic  systems  is  shown  in  Figure  2.0-7.  Here,  the  block-diagonal 
matrix  A  represents  the  known  subsystem  or  nominal  system  dynamics  while  the  o£f-block-diagonal 
matrix  G  represents  uncertain  subsystem  interactions  or  parametric  uncertainties.  Generally,  G  is 
stipulated  to  be  some  element  of  a  compact,  arcwise  connected  set  Q  which  describes  the  geometry 
and  severity  of  uncertainties.  The  simplest  prescription,  for  example,  is  that  Q  contains  all  off- 
diagonal  block  matrices  such  that  the  norm  of  each  off-diagonal  block  is  bounded  by  a  stipulated 
number. 

Note  that  the  disturbance  intensity  matrix  V  and  the  second-moment  matrix  Q  are  partitioned 
conformably  with  A  and  G.  We  bound  performance  degradation  due  to  uncertain  interactions  G 
ranging  over  the  admissible  set  Q  by  bounding  the  block-norm  matrix  of  Q.  To  do  this,  however, 
requires  additional  algebraic  tools,  such  as  the  Kronecker  algebra  which  centers  on  the  VEC  oper¬ 
ator,  Kronecker  product,  and  Kronecker  sum.  These  operations,  which  a^e  defined  by  the  relations 
shown  in  Figure  2.0-8,  are  critical  to  the  development.  The  reader  is  encouraged  to  consult  the 
review  paper  by  Brewer  [2.13]  for  a  thorough  discussion  of  the  Kronecker  algebra.  Because  of  the 
algebraic  complexity  of  deriving  majorants  for  the  second-moment  matrix,  the  Kronecker  algebra 
is  far  more  than  a  mere  notational  convenience. 

For  our  development,  the  standard  Kronecker  algebra  is  a  completely  adequate  tool  only  when 
each  subsystem  (with  dynamics  A*,  k  =  1, . . .  ,r)  is  one-dimensional.  However,  we  are  concerned 
with  systems  composed  of  many  high-dimensional  subsystems.  To  handle  the  algebraic  work, 
one  needs  a  generalization  of  the  Kronecker  algebra,  namely,  the  block- Kronecker  algebra.  The 
underlying  operations  of  the  VECb  operator  are  the  block  Kronecker  product  and  sum  which  are 
displayed  in  Figure  2.0-9.  Note  that  while  the  VEC  operator  stacks  the  columns  of  a  matrix  into  a 
vector,  the  VECb  operator  stacks  the  VEC’s  of  the  columns  of  subblocks  in  a  partitioned  matrix. 


2-10 


I 


x  =  (A  +  G)  x  +  w 


0 - 


Known  Subsytem  Dynamics 


Os(A  +  G)Q  +  Q(A  +  G)t+V 


Gil  Gl2 - 

G  a  G21  G22 
I  V 

I  V 


Uncertain  Subsystem  Interaction 
and  Nominal  Dynamics 


Vn  V12  ~ 

V  *  V21  V22 


se  Intensity 


Qii  Qi 2 - 

Q  =  q21  °22 

*  v 


State  Covariance 


Figure  2.0-7.  Subsystem  Interaction  Model 
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Figure  2.0-8.  Kronecker  Matrix  Algebra 
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Definitions. 
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Figure  2.0-9.  Biock-Kronecker  Algebra 


If  .the  subblocks  of  the  partitioned  matrix  M  are  all  one-dimensional,  the  block- Kronecker  algebra 
definitions  given  in  Figure  2.0-9  revert  to  those  given  in  Figure  2.0-8.  Moreover,  the  block-Kronecker 
algebra  is  endowed  with  the  same  battery  of  identities  as  in  the  standard  Kronecker  algebra.  These 
identities,  shown  in  Figure  2.0-10,  are  invaluable  in  effecting  the  required  algebraic  manipulations 
to  obtain  the  results  discussed  below. 

In  particular,  using  the  block-Kronecker  algebra,  one  can  first  reduce  the  second-moment  Lya- 
punov  equation  into  a  rather  compact  equation  determining  the  diagonal  subblocks  (the  individual 
subsystem  second-moment  matrices)  alone.  This  equation  is  the  second  from  the  top  in  Figure 
2.0-11.  With  this  as  the  starting  point,  one  then  applies  majorant  analysis  to  obtain  a  hierarchy  of 
majorant  bounds  as  shown  in  the  bottom  half  of  Figure  2.0-11.  As  in  the  Lp  bound  analysis,  each 
successive  member  of  the  hierarchy  offers  less  and  less  conservative  bounds. 

Note  that  having  obtained  the  expressions  shown  in  Figure  2.0-11,  we  do  not  calculate  the 
block-Kronecker  sums  and  products  explicitly.  Rather,  in  each  case,  we  reverse  the  VECb  operator 
to  reduce  each  member  of  the  hierarchy  of  bounds  to  a  low-order  modified  Lyapunov  equation  for 
the  matrix  majorant  of  the  second-moment  matrix. 

We  now  consider  in  more  detail  the  first  two  members  of  the  majorant  hierarchy  in  order  to 
illustrate  the  specific  forms  of  the  modified  Lyapunov  equations  that  are  obtained.  For  example, 
Figure  2.0-12  shows  the  first  member  of  the  second-moment  majorant  hierarchy.  This  gives  the 
majorant  2  as  the  solution  of  a  simple  nonnegative  matrix  equation,  where  *  denotes  the  Hadamard 
(element-by-element)  product  and  the  dimension  of  the  equation  is  the  number  of  subsystems.  For 
the  norm-bounded  uncertainty  set  shown  in  Figure  2.0-12,  the  existence  of  a  nonnegative  solution 
implies  a  bound  for  the  block-norm  matrix  of  the  second  moment  in  addition  to  robust  stability, 
i.e.,  A -I-  G  is  stable  for  all  perturbations  G  in  the  norm-bounded  set. 

One  particular  advantage  of  the  first  member  of  the  hierarchy  is  that  it  correctly  shows  the 
effect  of  wide  frequency  separation  of  subsystems  on  performance  degradation  and  robust  stability. 
This  effect  is  illustrated  in  Figure  2.0-13.  Here  we  have  two  subsystems  whose  poles  are  indicated 
by  the  crosses  in  the  complex  plane,  with  Kj  and  denoting  the  damping  of  the  subsystems  and 
u>x~u) 2  the  separation  in  frequencies.  The  majorant  equation  in  Figure  2.0-12  gives  the  expression 
shown  in  Figure  2.0-13  for  the  square  of  the  tolerable  interaction  strength  under  which  stability 
is  preserved.  Thus,  if  the  frequency  separation  (wi-w?)  is  large,  then  even  very  large  uncertain 
interactions  can  be  tolerated.  In  contrast,  the  vector  Lyapunov  function  theory  of  [2. 7, 2. 8]  would 
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1 .1 

(A+B)  ®  C  =  A  ®  C  +  B  ®  C 

1.2 

A  ®  (B+C)  =  A  ®  B  +  A  ®  C 

1.3 

(A  ®  B)T  =  AT  ®  BT 

1.4 

(A  ®  E)  (C  ®  D)  =  (AC)  ®  (BD) 
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(A  ®  E)'1  =  A"1  ®  B_1 
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veeb  (AYB)  =  (BT  ®  A) veeb  Y 

I  .7 

veeb  (AX  +  Xb)  =  (BT  @  A) veebx 
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Figure  2.0-10.  Identities  for  the  Block  Kronecker  Algebra 
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Figure  2.0-11.  A  Hierarchy  of  Majorant  Bounds  for  the  Second-Moment  Matrix 
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ROBUSTNESS  DUE  TO  WEAK 
SUBSYTEM  INTERACTION 


give  1/1  +  i/2  which  is  a  much  more  conservative  result  for  lightly  damped  systems.  Thus,  the 
majorant  equation  will  correctly  predict  that  as  frequency  separation  becomes  sufficiently  large, 
subsystems  become  effectively  decoupled.  Such  predictions  cannot  be  made  by  either  the  small 
gain  theorem  for  large-scale  systems  or  by  vector  Lyapunov  theory.  Thus,  even  the  first  member 
of  the  majorant  hierarchy  offers  greatly  reduced  conservatism  compared  to  previous  results. 

Moreover,  note  that  thanks  to  the  properties  of  M-matrices,  the  first  (and  all  higher)  members 
of  the  hierarchy  of  majorant  bounds  require  only  a  simple  iterative  sequence  for  their  computation. 
The  relevant  facts  are  summarized  in  Figure  2.0-14.  The  sequence  is  monotonically  nondecreasing, 
and  each  iteration  requires  only  two  matrix  additions,  two  multiplications  and  a  Hadamaxd  product 
for  its  computation.  Convergence  of  the  sequence  implies  robust  stability  while  the  degradation  of 
a  quadratic  performance  index  J  from  its  nominal  (zero  interaction)  value  J0  is  given  in  terms  of 
Q.  by  the  simple  expression  at  the  bottom  of  Figure  2.0-14. 

Furthermore,  the  second  member  of  the  second-moment  majorant  hierarchy,  shown  in  Figure 
2.0-15,  gives  even  tighter  bounds  and  can  even  predict  the  nondestabilizing  effect  of  certain  kinds 
of  perturbations.  The  form  of  the  majorant  equation  (top  of  Figure  2.0-15)  is  similar  to  the 
first  member  of  the  hierarchy  except  that  the  operator  X  [£>]  appears.  This  operator  is  precisely 
what  would  arise  in  the  equation  for  the  second-moment  matrix  for  a  system  with  Stratonovich 
multiplicative  noise  parameters!  So  far,  we  have  discussed  a  design  analysis  tool  for  predicting 
performance  degradation  due  to  uncertainty.  This  crucial  observation  brings  us  to  consideration  of 
the  link  between  majorant  robustness  analysis  and  MEOP  design  synthesis  theory. 

Figure  2.0-16  illustrates  this  link  and  the  accompanying  sequence  of  logical  developments. 
Overall,  one  may  regard  the  MEOP  design  synthesis  theory  as  arising  from  a  particular  robustness 
analysis  tool.  Although  any  member  of  the  second-moment  majorant  hierarchy  might  be  chosen  as 
the  basis  of  a  design  synthesis  theory,  we  choose  the  second  member  of  the  hierarchy  (see  the  lower 
right  block  in  Figure  2.0-16)  to  serve  as  the  point  of  departure  since  it  is  the  simplest  bound  that 
also  handles  nondestabilizing  uncertainties.  Referring  to  the  lower  left  block  of  Figure  2.0-16,  it  is 
seen  that  the  second-moment  equation  of  a  multiplicative  Stratonovich  noise  model  essentially  gives 
an  approximation  to  the  majorant  equation  and  a  smooth  optimization  problem.  The  Stratonovich 
second  moment  equation  then  leads  to  an  auxiliary  optimization  problem  (upper  left  block  in  Figure 
2.0-16),  namely,  cnoose  dynamic  compensator  gains  to  minimize  the  quadratic  performance  of  a 
system  having  multiplicative  stochastic  parameters.  Because  of  the  Stratonovich  modifications  to 
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Figure  2.0-14.  Numerical  Solution  of  the  Majorant  Lyapunov  Equation 
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Second  member  of  the  hierarchy: 
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Figure  2.0-15.  Second  Member  of  the  Majorant  Hierarchy 
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Figure  2.0-16.  Majorant  Hierarchy  and  Stratonovich  Models: 
the  Link  Between  Analysis  and  Synthesis 
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the  standard  form  of  the  Lyapunov  equation  that  appear  in  the  equation  for  Q,  the  robust  stability 
condition  implied  by  the  majorant  equation  is  still  enforced  since  the  optimization  problem  imposes 
a  robust  performance  constraint. 

The  optimization  of  an  apparently  stochastic  system  actually  approximates  the  majorant  bound 
which  -was  derived  purely  deterministically  and  leads  to  the  rather  elegant  MEOP  optimality  con¬ 
ditions  given  in  the  upper  right  block  in  Figure  2.0-16. 

Of  course,  the  use  of  Stratonovich  stochastic  models  was  earlier  indicated  by  maximum  entropy 
principles  and  stochastic  approximation  theory,  and  this  line  of  development  still  stands.  But  the 
import  of  the  more  recent  majorant  analysis  developments  is  that  there  is  a  direct  link  between 
maximum  entropy  stochastic  modeling  and  deterministic  performance  bounds.  This  link  strength¬ 
ens  the  foundations  of  MEOP  synthesis  theory  and,  most  importantly,  tends  to  blur  the  distinctions 
between  stochastic  and  deterministic  points  of  view.  This  is  just  as  well  since  the  task  confronting 
the  systems  and  control  theory  community  is  not  to  resolve  the  stochastic  versus  deterministic 
debate  one  way  or  the  other,  but  rather  to  rise  above  it.  As  the  work  described  here  suggests,  there 
is  a  plane  upon  which  the  points  of  view  are  numerically  indistinguishable . 

2.1  Additional  Extensions  of  Majorant  Analysis  to  Frequency-domain  Analysis 
and  to  Time-domain  Transient  Response 

The  previous  section  outlined  the  general  majorant  theory  in  an  operator  setting,  discussed  its 
application  to  the  bounding  of  uncertainty  effects  on  statistical  response,  and  noted  the  connections 
between  second-moment  majorant  analysis  and  MEOP  design  synthesis  theory.  Here  we  discuss 
additional  developments  of  majorant  theory  which  go  beyond  considerations  of  any  particular  design 
synthesis  approach  to  provide  new  and  more  powerful  tools  for  system  robustness  analysis. 

The  first  of  these  applications  concerns  the  use  of  majorants  for  frequency-domain  robustness 
analysis.  Here,  we  specialize  to  linear,  time-invariant  systems  and  assume  Li  system  inputs  and 
outputs.  Referring  to  the  notation  of  Figure  2.0-2,  let  p  —  2,  and 

l-CUa  =  sup  |£(«'w)|j,  (2-1-1) 

weIR 

where  £(s)  is  a  partitioned  matrix  of  transfer  function  blocks  and  j  •  |j  denotes  the  block-norm 
matrix  associated  with  the  matrix  2-norm.  Instead  of  dealing  with  t[H)  and  C‘(X)  directly,  we 
seek  C(M,w)  such  that 

£(#,w)  >>  sup  |£(»w)|2  =  £*(!/, (jj). 
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In  other  words,  we  determine  frequency-dependent  bounds  on  subsystem  transfer  function  blocks  so 
that  the  block-Lj  norm  bounds  are  then  easily  obtained  via  relation  (2.1-1).  This  approach  permits 
considerable  insight  into  the  impact  of  subsystem  frequency  response  and  generalizes  singular-value 
analysis. 

Reference  [112]  specialized  the  majorant  hierarchy  of  Figure  2.0-5  to  the  above  setting  to  pro¬ 
duce  a  frequency  domain  majorant  analysis  which  can  nonconservatively  address  highly  structured 
uncertainties.  Numerical  results  given  in  [112]  illustrate  convergence  of  the  frequency  domain  ma¬ 
jorant  hierarchy  to  nonconservative  bounds  which  are  clearly  superior  to  singular-value  analysis 
and  previously  developed  large-scale  system  methods. 

A  further  extension  of  majorant  analysis  is  concerned  with  analyzing  the  impact  of  uncertainties 
on  system  transient  response  in  the  time  domain.  In  essence,  we  specialize  the  formulation  of 
Figure  2.0-2  to  input  and  output  spaces.  In  other  words,  system  inputs  and  outputs  are 
characterized  as  functions  which  are  pointwise  bounded  in  time.  The  general  majorant  hierarchy 
has  been  specialized  to  this  case  both  for  continuous-time  and  discrete-time  systems.  Because 
of  its  direct  applicability  to  numerous  current  spacecraft  pointing  design  problems,  its  utility  in 
establishing  system  identification  requirements,  and  its  potential  for  extension  to  nonlinear  control 
system  analysis,  we  discuss  the  discrete-time  system  majorant  analysis  results  in  more  detail  below. 

Figure  2.1-1  depicts  the  basic  formulation  and  motivation  of  the  discrete-time  majorant  analysis. 
Here,  as  before,  we  use  a  subsystem  decomposition  representation  where  the  actual  system  differs 
from  the  nominal  system  model  via  an  uncertain  interaction  matrix  G.  Typically,  we  suppose  that 
the  block-norm  of  G  is  bounded  by  some  nonnegative  matrix  G  so  that  G  describes  the  magnitude 
of  the  modeling  uncertainties.  More  highly  structured  sets  for  G  have  also  been  considered.  The 
principal  goal  of  the  discrete-time  majorant  analysis  is  to  determine  a  worst  case  bound  on  the 
off-nominal  prediction  error ,  E(k)  =  x(k)  —  x(k)  as  a  function  of  the  discrete-time  index  when  G 
ranges  over  the  set  of  uncertainties  (i.e.,  |G|  <<  G).  To  do  this,  the  general  majorant  hierarchy  of 
Figure  2.0-5  has  been  specialized  to  this  setting.  Figure  2.1-2  explicitly  shows  that  the  0th  order 
majorant  is  essentially  a  vector  Lyapunov  bound  and  the  1st  member  can  be  shown  to  be  always 
less  conservative  than  the  0th  order  bound.  Note  that  all  these  majorants  represent  upper  bounds 
for  the  exact  worst  case  off-nominal  prediction  error  E*(k ),  where  E*(k)  is  defined  as 

E*(k)  =  sup  |x(fc)  -  f(Jk)|. 

Beginning  with  the  first-order  majorant,  there  is  an  associated  lower  bound  for  E‘(k).  In  other 
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Figure  2.1-1.  Time-Domain  Robustness  Analysis  Problem 
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TIME  DOMAIN  MAJORANT 
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Figure  2.1-2.  Time-Domain  Majorant  Bound 


2-26 


I 


■ 


l 

1 


» 


I 


words,  the  first-order  and  higher  order  majorant  bounds  produce  two  nonnegative  matrix  functions 
of  time  E(k)  and  £(k)  such  that 

£(fc)  <<  E‘{k)  <<  E(k). 

Thus,  the  theory  provides  not  only  an  upper  bound  on  prediction  error  but  also  a  measure  of 
conservatism  of  the  bound,  i.e.,  E(k)  —  £[k). 

To  illustrate  the  capabilities  of  the  time-domain  majorants,  we  discuss  an  example  given  in  [91]. 
This  example,  depicted  in  Figure  2.1-3,  considers  a  tracking  problem  where  a  flexible  spacecraft 
with  a  rigidly  mounted  antenna  must  track  a  target  through  an  encounter  which  takes  5.0  seconds 
and  covers  180  degrees.  To  illustrate  the  system  analysis  aspect  of  majorants,  we  suppose  that  the 
tracker  control  loop  was  designed  taking  into  account  only  the  rigid  body  dynamics  and  that  all 
that  is  known  about  the  dynamics  is  that  there  are  modes  above  20  Hz  with  specified  bounds  on 
the  elastic  modal  coefficients  associated  with  the  tracker  sensor  and  thrusters.  Given  this  rather 
crude  knowledge  of  the  elastic  modes,  it  is  required  to  determine  how  much  the  actual  closed-loop 
tracking  performance  can  deviate  from  the  predictions  of  the  nominal,  rigid-body  model.  Thus,  we 
illustrate  not  only  the  effects  of  uncertainty  but  also  the  utility  of  majorants  in  ascertaining  the 
impact  of  unmodeled  dynamics.  An  additional  objective  is  to  indicate  how  majorant  bounds  can 
be  used  to  determine  the  quality  of  system  identification  necessary  to  support  system  certification 
for  flight. 

Details  of  the  problem  formulation  and  the  analytical  setup  are  given  in  [91].  Figures  2.1-4a,b 
show  final  results  for  various  cases  in  which  the  first-order  majorant  bound  has  been  applied.  In 
each  of  these  graphs,  we  show  five  curves.  The  central  curve  is  the  trajectory  predicted  by  the 
nominal  model  which  includes  only  the  rigid  body  dynamics;  in  addition  we  plot  the  nominal 
trajectory  plus  or  minus  the  upper  bound  E(k)  on  the  exact  worst-case  prediction  error;  finally,  we 
also  show  the  nominal  plus  or  minus  the  lower  bound  £(k)  on  the  exact  worst  case  error  E'{k). 
Note  that  despite  the  uncertain  elastic  mode  effects,  the  actual  system  trajectory  is  certain  to  lie 
between  the  outermost  curves.  Thus,  majorants  predict  not  merely  a  single  trajectory,  but  rather 
a  “tube”  or  band  wherein  the  actual  trajectory  must  lie.  Furthermore,  note  that  in  all  cases  the 
curves  representing  nominal  ±E(k)  and  nominal  ±£(k)  are  relatively  close  thereby  indicating  that 
the  upper  bound  on  the  prediction  error  entails  very  little  conservatism.  In  particular,  in  cases  1, 
3  and  4,  the  curve  corresponding  to  upper  and  lower  bounds  are  so  close  together  that  they  cannot 
be  distinguished. 
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CASE  3:  fes5.0  Hz,  0.1  X  UNCERT. 


CASE  4:  fc=5.0  Hz,  0.01  X  UNCERT. 


Figure  2.1-4b.  Additional  Results  for  Spacecraft  Tracking  Example 
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Referring  to  Figure  2.1-4a,  in  particular,  cases  1  and  2  show  how  increasing  the  controller 
bandwidth  (from  1.0  Hz  to  5.0  Hz)  reduces  the  nominal  target  tracking  error  but  increases  the 
prediction  error  for  a  given  amount  of  elastic  mode  uncertainty.  This  illustrates  the  use  of  ma- 
jorant  analysis  to  help  determine  controller  bandwidths  appropriate  for  the  precision  of  modeling 
information.  Cases  2  through  4  show  how  decreasing  the  elastic  mode  uncertainty  decreases  the 
performance  bounds.  In  going  from  case  2  (Figure  2.1-4a)  to  case  4  (Figure  2.1-4b)  the  uncertainty 
is  reduced  by  an  order  of  magnitude  each  time.  This  shows  the  capability  of  majorant  analysis  to 
ascertain  the  precision  of  system  identification  that  is  required  to  attain  a  given  level  of  guaranteed 
performance.  In  the  present  example,  it  is  see  that  a  20  multi-radian  tracking  specification  would 
require  a  system  ID  test  that  reduces  model  uncertainty  by  an  order  of  magnitude. 
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3.1  Review  of  Centralized  Theory 

Optimal  projection  control-design  theory  has  undergone  considerable  development  over  the  past 
several  years.  As  shown  in  Figure  3.1-1,  optimal  projection  theory  now  encompasses  problems  in 
reduced-order,  robust  modeling,  estimation  and  control  in  both  continuous-time  and  discrete-time 
settings.  A  comprehensive  reference  list  appears  in  Section  5.0. 

For  control-design  purposes  optimal  projection  theory  provides  new  machinery  for  synthesizing 
multivariable  feedback  controllers.  This  machinery  consists  of  a  system  of  algebraic  design  equations 
which  characterize  optimal  feedback  controllers  while  accounting  for  both  controller  order  and 
parameter  uncertainties.  The  design  equations  consist  of  a  system  of  two  algebraic  Riccati  equations 
and  two  algebraic  Lyapunov  equations  coupled  by  both  an  oblique  projection  and  uncertainty  terms. 
The  Riccati  equations  are  directly  related  to  the  pair  of  separated  Riccati  equations  arising  in  LQG 
theory.  Indeed,  when  the  controller  order  is  set  equal  to  the  order  of  the  plant  and  all  uncertainties 
are  absent,  then  the  design  equations  specialize  immediately  to  the  standard  LQG  equations. 

3.2  Extensions  to  Decentralized  Controllers 

In  keeping  with  the  optimal  projection  philosophy,  our  approach  to  decentralized  control  design 
is  based  upon  fixed-structure  optimization.  That  is,  we  assume  that  the  structure  of  the  controller 
is  determined  by  implementation  constraints  and/or  subsystem  analysis.  Once  the  controller  ar¬ 
chitecture  is  fixed,  the  feedback  gains  can  be  chosen  to  optimize  the  performance  functional  for 
the  closed-loop  system.  This  approach  can  be  used  to  determine  preferable  controller  architec¬ 
tures  by  varying  the  decentralized  information  structure  and  optimizing  the  performance  of  each 
configuration. 

The  fixed  structure  approach  is  distinct  from  methods  which  are  based  upon  subsystem  de¬ 
composition  with  centralized  design  procedures  applied  to  the  individual  subsystems.  For  such 
methods  there  remains  the  problem  of  determining  conditions  under  which  the  reassembled  closed- 
loop  system  has  acceptable  behavior.  An  additional  drawback  of  decomposition  methods  is  that 
the  decentralized  controller  architecture  specified  by  implementation  constraints  may  be  completely 
unrelated  to  desirable  architectures  arising  from  dynamical  considerations.  For  example,  physical 
implementation  constraints  may  impose  a  particular  decentralized  architecture  which  does  not  cor¬ 
respond  to  any  discernible  dynamical  decomposition.  Furthermore,  subsystem  decomposition  as  a 
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Figure  3.1-1.  Scope  of  MEOP 
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design  tool  may  constrain  the  class  of  attainable  designs  at  the  expense  of  achievable  performance. 

Of  course,  in  many  cases,  such  as  the  presence  of  high  dimensionality,  subsystem  decomposition 
is  absolutely  essential  for  making  progress  in  designing  decentralized  controllers.  However,  only  by 
developing  methods  which  avoid  unnecessary  constraints  on  the  design  space  can  the  efficiency  of 
decomposition  methods  be  assessed.  Furthermore,  methods  which  retain  the  full  system  dynamics 
may  provide  a  useful  starting  point  for  applying  existing  decomposition  techniques  as  well  as  the 
means  for  developing  new  methods. 

Our  overall  approach  is  thus  to  regard  the  fixed-structure  approach  as  complementary  to  sub¬ 
system  decomposition  techniques.  To  this  end,  majorant  robustness  analysis  has  been  developed 
(see  Section  2.0)  to  account  for  subsystem  interactions  arising,  for  example,  from  system  uncertain¬ 
ties.  In  addition,  majorant  robustness  analysis  is  closely  related  to  MEOP  synthesis  particularly 
with  regard  to  nondestabilizing  uncertainties. 

3.2.1  Decentralized  Control1  Design  for  Static  Controllers 

We  first  consider  the  problem  in  which  each  subcontroller  is  assumed  to  be  static,  i.e.,  a 
fixed  gain  multiplying  the  measurements.  For  realism,  of  course,  only  the  physical  measurements 
are  assumed  to  be  available  for  feedback.  Earlier  versions  of  this  problem  were  considered  in 
[3. 1,3. 2].  The  most  general  treatment  of  this  problem  obtained  thus  far  can  be  found  in  [122]. 
The  development  in  [122]  includes,  in  particular,  noisy  and  nonnoisy  measurements,  weighted  and 
unweighted  controls,  and  parameter  uncertainties  in  the  A,  B,  and  C  matrices.  The  optimality 
conditions  for  this  problem  are  given  in  the  form  of  a  pair  of  modified  Riccati  equations  coupled  by  a 
pair  of  oblique  projections  corresponding,  respectively,  to  singular  measurement  noise  and  singular 
control  weighting.  By  utilizing  a  Lyapunov  function  to  guarantee  robust  stability,  these  optimality 
conditions  serve  as  sufficient  conditions  for  robust  stability  and  performance  over  a  specified  range 
of  parametric  uncertainty. 

3.2.2  Decentralized/Hierarchical  Controller  Design  for  Dynamic  Controllers 

A  more  complex  situation  arises  when  the  decentralized  subcontrollers  are  allowed  to  be  fixed- 
order  dynamic  controllers.  As  an  additional  element  of  complexity,  we  assume  the  various  decen¬ 
tralized  dynamic  controllers  are  combined  within  a  general  multiechelon  hierarchical  control  (MHC) 
structure,  illustrated  conceptually  in  Figure  3. 2.2-1  which  is  given  in  [3.4].  This  is  the  most  general 
arrangement  of  decentralized  control  elements  and  consists  of  a  number  of  subsystems  situated  in 
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levels  such  that  each  one  can  coordinate  lower-level  units  and  be  coordinated  by  a  higher-level 
one.  Previous  work,  described  above,  which  considers  a  purely  decentralized  (but  nonhierarchical) 
architecture,  represents  the  special  case  of  Figure  3.2.2-1  in  which  only  the  first  hierarchical  level 
is  present. 

Specific  realization  of  an  MHC  system  within  the  context  of  linear  dynamic  compensation  is 
illustrated  by  the  typical  configuration  shown  in  Figure  3.2.2-2a.  Here  compensators  on  the  first 
level  interact  directly  with  the  large  scale  structure  to  be  controlled.  Compensators  on  higher 
levels  receive  linear  combinations  (defined  by  the  matrices  D^)  of  the  direct  sensor  mesurements 
(yj*^)  and  the  dynamic  states  (?^)  of  the  lower- level  compensators  as  inputs  and  produce  output 
control  signals  (u^),  which  serve  to  coordinate  and  reconcile  the  (sometimes  competing)  actions 
of  the  lower-level  compensators.  The  disposition  of  control  inputs,  measurements  and  the  matrices 
Dl>\Ey  defining  each  coordination  level  are  defined  by  practical  implementation  and  communica¬ 
tion  constraints.  The  important  motivations  for  the  MHC  arrangement  are  to  reduce  processor  cost 
and  complexity  by  breaking  up  the  processing  task  into  relatively  small  pieces  and  to  decompose 
the  fast  and  slow  control  functions.  Typically,  the  lower  levels  involve  relatively  simple  compen¬ 
sation  but  relatively  high  bandwidth,  while  the  upper  levels  may  utilize  more  nearly  centralized 
and  higher-order  compensation  with  relatively  low  bandwidth.  To  reduce  individual  processing 
burden,  it  is  essential  that  for  each  subcontroller,  the  number  of  inputs  (yj‘^),  outputs  (u^)  and 
the  dimension  of  the  compensator  be  relatively  small. 

Figure  3.2.2-2b  defines  the  problem  further  by  defining  the  generic  arrangement  of  the  jth 
dynamic  compensator  on  the  «th  hierarchical  level.  It  is  seen  that  each  compensator  is  of  the  form 
of  an  output  feedback  dynamic  compensator  whose  dimension  is  a  fixed  number  determined  by 
implementation  constraints.  We  address  the  quadratically  optimal  multiechelon  hierarchical,  fixed- 
order  control  design  problem,  i.e.,  choose  the  gain  matrices  A^ , Bc'J , ci'J ,  for  i  =  1,...,M  and 
j  —  1, . . . ,  Ni  for  all  the  dynamic  compensators  to  minimize  a  steady-state  quadratic  performance 
index  subject  to  the  selected  MHC  configuration  and  the  compensator  dimension  constraints. 

This  optimization  problem  is  nonconvex  and  displays  multiple  local  extrema.  Figure  3.2.2-3 
illustrates  the  general  difficulties  and  indicates  our  overall  strategy  for  solving  such  nonconvex  opti¬ 
mization  problems.  The  two-state  strategy  consists  in  (1)  computing  all  extremalizing  designs,  i.e., 
control  gains  for  which  =  0>  by  solving  the  first-order  necessary  conditions 

(FONC)  for  the  optimization  problem  and  then  (2)  selecting  the  design  which  is  determined  to  have 
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Large  Scale  System 


Figure  3.2.2-2b.  Detail  of  the  jth  Dynamic  Compensator  of  the  ith  Level 


1 .  Compute  All  Extremal  Designs  By 
Solving  The  First-Order  Necessary 
Conditions  for  the  Optimization 
Problem. 

*  How  many  solutions  are  there? 

*  How  can  the  solutions  be  computed? 


2.  For  All  Design  in  Step  1 .  Compute  the 
Performance  J  and  Select  the  Design 
with  the  Best  Performance. 


*  Gradient  Search  Methods  Can  Converge  To  High-Cost  Local  Minima  and  Cannot  Assure 
Global  Optimality 


*  Above  Strategy  Avoids  These  Pitfalls,  but  Feasibility  Requires  Satisfactory  Answers  to 
Questions  About  Multiplicity  of  Solutions  and  Effective  Solution  Algorithms 


Figure  3.2.2-3.  Strategy  for  Solving  the  Optimal  Multiechelon  Hierarchical 

Control  Design  Problem 


the  smelliest  quadratic  cost.  Although  this  approach  avoids  the  pitfalls  of  gradient  search  methods 
and  can  guarantee  global  optimality,  its  feasibility  requires  that  the  number  of  FONC  solutions  be 
relatively  small  (no  more  than  one,  ideally)  and  that  there  exist  effective  algorithms  for  computing 
the  FONC  solutions. 

Immediately  below  we  discuss  results  on  the  derived  forms  of  the  FONC  and  then  address 
questions  about  multiplicity  of  solutions  and  effective  solution  algorithms  in  the  remainder  of  this 
section  and  in  the  following  section. 

First,  the  overall  FONC  comprise  the  set  of  all  first-order  necessary  conditions  for  each  sub¬ 
controller  individually.  Figure  3.2.2-4  shows  that  the  formulation  of  the  FONC  corresponding  to 
compensator  (t,  j)  (jth  controller  on  the  »th  hierarchical  level)  is  exactly  identical  to  the  formulation 
of  first-order  necessary  conditions  for  a  single  centralized,  fixed-order  compensator  for  an  “equiv¬ 
alent  plant”  which  comprises  the  dynamics  of  the  original  plant  and  all  the  other  subcontrollers. 
The  necessary  conditions  for  this  “equivalent”  centralized  design  problem  are  well  known  by  virtue 
of  the  earlier  MEOP  development.  Thus,  we  immediately  obtain  for  the  (i,  j)th  compensator  the 
FONC  shown  in  Figure  3.2.2-5a,b. 

Thus,  the  first-order  necessary  conditions  of  the  quadratically  optimal  MHC  design  problem 
decompose  into  sets  of  four  nonlinear  matrix  equations  (Figure  3.2.2-5b)  involving  one  set  of  four 
equations  for  each  of  the  subcontrollers  in  the  multiechelon  hierarchical  system.  Each  set  of  four 
equations  has  a  form  identical  to  the  four  MEOP  design  equations  for  centralized  design,  namely, 
two  modified  Riccati  and  two  modified  Lyapunov  equations,  all  coupled  by  an  oblique  projection 
r(».j)  which  characterizes  the  geometric  structure  of  the  (»,/)th  fixed-order  compensator.  These 
results  directly  generalize  earlier  results  for  the  purely  decentralized  problem  in  [76], 

Clearly,  the  overall  FONC  will  display  multiple  solutions  (since  this  is  the  case  for  fixed-order, 
centralized  design)  corresponding  to  the  various  local  extrema.  The  decomposition  of  the  FONC 
noted  above  shows  that  the  key  to  establishing  the  number  of  solutions  is  to  determine  the  number 
of  solutions  to  the  MEOP  design  equations  for  centralized  fixed-order  compensation.  Specifically,  the 
next  section  discusses  new  results  which  establish  a  generic  upper  bound  on  the  number  of  solutions 
to  the  MEOP  centralized  control  design  equations.  Using  these  results,  one  can  determine  an  upper 
bound  on  the  number  of  solutions  to  the  matrix  equations  (Figure  3.2.2-5b)  corresponding  to 

the  (*,jf)th  compensator,  where  is  independent  of  the  other  subcontrollers.  Then,  considering 
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ARE  THE  SAME  AS  FONC  FOR  THE  “(«',j)th  EQUIVALENT  OPTIMIZATION  PROBLEM”: 


“EQUIVALENT  PLANT”  FOR  (i,j)  COMPENSATOR 


PERFORMANCE  CRITERION 
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AND  dim (,«)  =  n'*'y) 


I 


Figure  3. 2.2-4. 


Derivation  of  First-Order  Necessary  Conditions 
for  Compensator  (i,j) 
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GAIN  EXPRESSIONS: 


4/  =  r(‘-y)(A.  -  B.R^P.  -  Q.VfScjGW 
B[c?  =  T^Q.Vf,1 

clf  =  -R^P.G^ 


NOTATION 


Q(iJ)p(i,3)  _  G(*.i)rM(ilJ)r(ilJ)>  r(i.y)G(M)T  _  /n  ^  r(.r.,)  _  G(<lJ)Tr(<>3)  _  r(*.y)a^ 
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p 


AQ^At  =  ^2  A^j)Q^'>A^'j)T, 

k=  1 


AQ^B  etc. 

fc=i 


At  =  +  jA*  B.  =  +  \AB  C.  =  C(*'i3>  +  \CA 


R*.  =  +  P^)B 

Q.  =  Q(,j)cf  +  +  q(»*j))ct 


v„  =  y2(,,y)  +  c(q^3>  +  q^)ct 

P,  =  Bj  P(i|3)  +  -f  5T(p(‘.»  +  pKi))^ 


Figure  3.2.2-5a.  First-Order  Necessary  Conditions  Pertaining  to  (i,j)th  Compensator 
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SOLVE  FOR  NONNEGATIVE-DEFINITE  QliJ\  P^\  P(i^ 

0  =  AsQ(iJ)  +  Q(<l3)A?  -I-  AQ(i‘3']AT  +  v}iJ)  +  {A  -  BR^Pt)Q{'^{A  -  BR^P.)T 
-  Q.Vft1Q?  +  T^)Q.Vi-lQlT™T 

0  =  +  P™A,  +  AtP^A  +  +  (A-  Q.VfScfP^iA  -  Q.Vf.'C) 

~  ?? R^P.  +  r^3)TPtTR^P.r^j) 

0  =  (A.  -  B.R^PJQ™  +  Q{i'3)(A.  -  B.R^P.f  +  Q.Vu'Q*  -  r™ Q.Vf.1  Qj r^)T 
0  =  (A,  -  Q,V^C.)tP^  4-  Pl'-»(A,  -  Q.Vf,lC.)  +  Pj'R^P,  -  r^i)T P JR^P,^ 

RANK  Q(*-3>  =  RANK  P{i’j)  =  RANK  Q^pHJ)  =  n(<. i) 

r(».y)  _  q(*-}) p(*.y)^(*,y) p(».y)j#  r(».»>  =  /n  _  r(*.i) 

#  =>  GROUP  GENERALIZED  INVERSE 

Figure  3.2.2-5b.  First-Order  Necessary  Conditions  (cont’d) 
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all  the  first  order  necessary  conditions,  it  follows  that 


^  Number  of  admissible  solutions  N 
to  the  FONC  for  the 
^  MHC  design  problem  j 


M  Ni 

<  n  n 


i=iy=i 


We  shall  see  that  in  many  practical  situations  the  above  number  is  quite  small  (indeed,  unity  in 
most  instances)  so  that  the  solution  strategy  of  Figure  3. 2.2-3  is  feasible  and  can  effectively  produce 
the  globally  optimal  solution. 


Also,  the  structure  of  the  first-order  necessary  conditions  for  the  MHC  problem  suggests  a 
solution  algorithm  consisting  of  the  sequential  solution  of  centralized,  fixed-order  design  equations 
for  each  subcontroller  in  turn.  We  have  developed  an  effective  MHC  solution  algorithm  by  first 
constructing  efficient  homotopy  solution  algorithms  for  the  centralized  design  problem  and  then 
applying  the  results  to  the  more  general  MHC  problem.  These  matters  are  discussed  in  the  next 
section. 
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4.0  Analysis  and  Solution  of  the  MEOP  Multiechelon  Hierarchical  Control 
(MEOP-MHC)  Design  Equations 

In  Section  3.2.2,  we  described  (see  Figure  3. 2. 2-3)  how  the  quadratically  optimal,  fixed-order 
multiechelon  hierarchical  control  problem  can  be  reduced  to  (1)  determination  of  all  admissible 
solutions  of  the  MEOP-MHC  design  equations  (Figure  3.2.2-5b)  and  (2)  selection  of  the  solution 
for  which  the  quadratic  cost  is  minimal.  As  noted,  the  feasibility  of  this  approach  depends  on  satis¬ 
factory  answers  to  questions  concerning  multiplicity  of  solutions  as  well  as  the  existence  of  effective 
solution  alogrithms.  However,  from  the  structure  of  the  MEOP-MHC  design  equations  noted  above 
we  have  discovered  that  optimal  MHC  dynamic  compensator  design  can  be  viewed  as  a  collection  of 
subcontroller  designs  obtained  for  an  augmented  system.  Essentially,  each  subcontroller  is  viewed 
as  a  reduced-order  controller  for  the  plant  augmented  by  all  other  subcontrollers.  This  problem  is 
thus  a  direct  application  of  centralized  MEOP  design  theory. 

In  Section  4.1  we  review  results  for  the  MEOP  centralized  design  theory  wherein  effective 
solution  algorithms  are  developed  and  then  show,  in  Section  4.2,  how  these  centralized  design 
results  are  applied  to  resolve  residual  issues  in  the  MHC  design  problem. 

4.1  Homotopic  Continuation  and  Degree  Theory  for 
Optimal  Fixed-Order,  Centralized  Control 

Here  we  return  to  consideration  of  the  optimal  fixed-order  dynamic  compensator  design  prob¬ 
lem,  approached  via  solution  of  the  MEOP  centralized  design  equations.  Note  that  this  is  also 
a  nonconvex  optimization  problem  with  multiple  extrema.  Thus  the  number  of  solutions,  their 
stability  properties,  and  determination  of  the  global  minimum  are  important  issues.  It  seems  clear 
that  any  attempt  to  address  these  issues  must  utilize  mathematical  methods  which  are  global  in 
nature.  To  this  end,  we  have  applied  topological  degree  theory  and  associated  homotopy  methods 
(see  [4. 1-4.3])  to  analyze  the  solutions  of  the  MEOP  centralized  design  equations  and  to  construct 
convergent  solution  algorithms.  In  essence,  a  homotopic  continuation  method  involves  first  solving 
an  “easy”  problem,  then  continuously  deforming  the  easy  problem  into  the  original  problem,  and 
finally  following  the  path  of  solutions  as  the  easy  problem  is  deformed  into  the  original  problem. 
This  is  shown  conceptually  in  Figure  4.1-1  where  the  dashed  lines  also  indicate  several  pathologies 
that  can  occur.  Here  t  is  the  continuation  parameter,  t  =  0  represents  the  easy  problem,  and  t  =  1 
corresponds  to  the  original  problem  to  be  solved. 

In  [63,68],  Richter  formulated  a  homotopy  method  and  then  applied  topological  degree  theory 
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to  develop  a  homotopy  method  for  solving  the  MEOP  equations  for  which  the  dashed  lines  in 

Figure  4.1-1  cannot  occur.  That  is,  the  only  solutions  to  the  MEOP  design  equations  at  t  =  0  (or 

for  0  <  t  <  1)  are  those  which  are  continuously  derived  from  the  solutions  at  t  =  0.  Furthermore, 

the  MEOP  equations  possess  at  most 

/ min(n,  m,  £)  —  nu\  .  .  ,  . 

1  ,  ne  <  rrun(n,m,cl, 

\  ne  ~  nu  / 

1,  otherwise, 


stabilizing  solutions  where  (“)  is  the  standard  combinatoric  notation,  nu  denotes  the  dimension  of 
the  unstable  subspace  of  the  plant,  n  is  the  plant  dimension,  m  the  number  of  control  inputs,  t 
the  number  of  sensor  outputs,  and  ne  is  the  desired  dimension  of  the  compensator.  Moreover,  each 
such  solution  is  reachable  via  a  homotopic  path.  Finally,  if  the  plant  is  stabilizable  by  means  of  an 
ncth-order  dynamic  compensator,  then  there  exists  at  least  one  solution  to  the  design  equations. 


Note  that  if  nc  is  larger  them  the  number  of  inputs  or  outputs,  then  there  is  only  one  solution 
to  the  MEOP  equations  and  this  solution  corresponds  to  the  global  minimum  of  the  quadratic 
performance  index.  Also  note  that  Richter’s  homotopy  algorithm  permits  the  a  priori  selection 
of  a  starting  solution  (all  starting  solutions  being  known  in  closed  form)  leading  to  an  admissible, 
final  solution.  Hence,  even  when  ne  <  min(n,m,£),  one  can  compute  all  solutions,  then  pick  the 
solution  corresponding  to  the  smallest  quadratic  cost. 


An  additional  benefit  of  the  homotopy  algorithm  is  the  ability  to  exploit  the  structure  of  the 
design  equations  to  an  even  greater  extent  than  the  iterative  algorithm.  Specifically,  Richter  has 
shown  that  the  computational  burden  using  the  homotopy  methods  involves  solving  four  equations 
of  order  ne  x  n.  Hence,  the  computational  requirements  decrease  as  nc  decreases.  This  is,  of  course, 
quite  pleasing  since  low-order  controllers  ought  to  be  easier  to  design  than  high-order  controllers. 
For  MHC  design  this  property  is  particularly  advantageous  since  it  will  generally  be  true  that 
nc  <<  n  where  n  is  the  plant  dimension  augmented  by  all  other  subcontrollers. 


Since  the  computational  burden  of  the  iterative  algorithm  tends  to  increase  as  nc  decreases,  the 
advantages  of  the  homotopy  algorithm  over  previously  developed  iterative  algorithms  are  obvious.  I 

Computational  savings  have  been  at  least  an  order  of  magnitude  and  final  convergence  has  been 
greatly  improved.  Moreover,  the  example  considered  in  [4.4]  and  [94]  was  reconsidered  using  the 
homotopy  algorithm  in  [63,68].  The  main  result  was  the  ability  to  produce  controllers  as  low 
as  second  order  at  control  authorities  which  were  three  orders  of  magnitude  beyond  the  cases 
considered  in  [4.4]  and  [94].  In  each  case  the  performance  of  the  reduced-order  controller  was 
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within  20  percent  of  the  full-order  design. 

In  summary,  the  homotopy  and  degree  theory  results  render  feasible  the  solution  strategy  for 
optimal  fixed-order  compensation  shown  in  Figure  4.1-2.  This  directly  parallels  Figure  3. 2. 2-3. 
Here,  we  compute  all  extremal  designs  by  solving  the  FONC  in  the  form  of  the  MEOP  design 
equations.  Degree  theory  shows  that  the  number  of  solutions  is  typically  small  and  homotopy 
algorithms  provide  efficient  methods  for  computing  the  solutions.  Thus,  effective  methods  exist  to 
carry  out  step  1  in  Figure  4.1-2.  Step  2  is  relatively  straightforward  and  its  completion  yields  the 
globally  optimal  solution  to  the  nonconvex  optimization  problem. 

It  is  evident  that  the  homotopy  results  for  fixed-order  centralized  control  represent  a  powerful 
vehicle  for  successfully  addressing  the  optimal,  fixed-order  multiechelon  hierarchical  control  prob¬ 
lem.  The  manner  in  which  these  results  have  been  adapted  to  the  MHC  problem  is  described  in 
the  next  section. 

4.2  Application  of  Homotopy  and  Degree  Theory  to 
Optimal  Multiechelon  Hierarchical  Control  Design 

We  now  return  to  the  questions  raised  in  connection  with  the  strategy  for  solving  the  optimal 
MHC  design  problem  depicted  in  Figure  3.2.2-3.  We  first  examine  how  many  solutions  exist  to  the 
MEOP/MHC  design  equations  shown  in  Figure  3.2.2-5b. 

Clearly,  the  first-order  necessary  conditions  for  the  (i,jf)th  subcontrollers  are  identical  to  the 
MEOP  design  equations  for  a  single  fixed-order  controller  in  the  presence  of  an  augmented  plant 
consisting  of  the  original  plant  and  all  other  subcontrollers.  Thus  the  degree  theory  results  on 
the  centralized  design  problem  can  be  applied  to  this  case.  For  the  (i,j)th  sucontroller,  let  m^'3^ 
denote  the  dimension  of  and  the  dimension  of  (see  Figure  3.2.2-2b).  To  simplify 
this  outline  of  results,  we  assume  an  open-loop  stable  plant  and  suppose  that  the  dimension  of 
the  augmented  “equivalent  plant”  for  the  (»,j)th  compensator  is  larger  than  either  or  £(,,3\ 

Then  under  these  rather  typical  conditions,  the  degree  theory  results  described  in  the  last  section 
can  be  utilized  to  show: 


/  Number  of  admissible  solutions  ^ 
to  the  MEOP-MHC  design 
equations  (equivalent  to  the 
^  FONC  for  the  MHC  design  problem) , 


M 

<  n  n  *,,ji 

«=  1  n  =  1 


(4.2-1) 
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1 .  Compute  All  C.L.  Stable  Designs  by 
Solving  MEOP  Equations  via  Richter’s 
Homotopy  Algorithm 

No.  of  Designs 

<  /  min(n,m,/)-n  \ 

-  \  nc  nu  ) 

(Typically  Small) 

2.  For  All  Designs  in  Step  1  Compute 
J(AC,  Bc,  Cc)  and  Pick  the  One  With 
Smallest  J 


*  Only  Method  Simultaneously  Guaranteeing  Parametric  Robustness  and  Order-Reduction 


*  Only  Known  Method  Guaranteeing  Global  Optimality 

*  Extended  to  Infinite-Dimensional  Systems  and  Design  Constraints  (Bernstein,  Haddad) 


Figure  4.1-2.  Solution  of  the  Optimal  Reduced- Order  Compensator 
|  Design  Problem  (Bernstein,  Hyland,  Richter) 


1 
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otherwise, 


When  it  is  recalled  that  the  design  of  simple  subcontrollers  requiring  little  on-line  computation 
necessitates  a  decentralized  control  structure  in  which  the  number  of  subcontrollers  inputs  and 
outputs  is  small,  it  is  seen  that  >/(*’*)  is  typically  a  small  number.  Also,  if  either  mSx'3^  or  £^'3^  is 
small  (say  <  4)  for  all «  and  j  then  one  can  choose 


n£’.'  >  min(m^’-,\^*’J^) 


(4.2-2) 


and  still  have  compensators  of  acceptably  small  dimension. 

If  the  above  choices  can  be  made  for  the  dimensions  of  all  the  subcontrollers,  then  is 

unity  for  all  t,j  and  the  MEOP-MHC  design  equations  have,  at  most,  one  solution.  Moreover,  one 
solution  always  exists  since  for  a  stable  plant,  a  stabilizing  MHC  design  exists  and  there  is  at  least 
one  extremalizing  design.  Since  the  MEOP-MHC  equations  are  the  first-order  necessary  conditions, 
they  have  at  least  one  solution  under  a  stabilizability  assumption.  Thus,  under  the  conditions 
postulated,  the  MEOP-MHC  design  equations  have  a  unique  solution  and  this  corresponds  to  the 
global  minimum  of  the  performance  index. 

The  above  results  render  step  1  in  Figure  3. 2.2-3  feasible.  Even  if  M^1’3^  >  1,  practical  con¬ 
straints  on  and  will  tend  to  keep  the  total  number  of  admissible  solutions  to  within  a 

manageable  level. 

Next,  retaining  assumption  (4.2-2)  we  consider  the  application  of  the  centralized  design  homo- 
topy  algorithm  discussed  in  the  previous  section  to  MHC  design.  The  structure  of  the  MEOP-MHC 
equations  immediately  suggests  sequential  design  as  in  [4. 5-4.7]  whereby  the  equivalent  centralized 
design  problem  is  solved  for  each  individual  subcontroller  in  turn.  Specifically,  let  each  (s’,  jT)  corre¬ 
spond,  one  to  one,  to  an  integer  k,  where  k  =  1, ... ,  Nt,  where 

M 

NT±J2Ni 

i=l 

is  the  total  number  of  subcontrollers.  With  this  re-indexing  of  the  subcontrollers,  consider  the 
following  algorithm: 

Start:  Choose  any  set  of  stabilizing  gains  (in  the  present  case,  it  suffices  to  choose  Ac*'  = 
Be'}  =  Ce}  =  0,  for  all  (i,j))  and  let  k  =  1  and  L  =  1. 


i 


I 
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1. A  Apply  the  homotopy  algorithm  to  solve  the  MEOP-MHC  equations  for  the  fcth  subcon¬ 

troller,  i.e.,  solve  the  equations  shown  in  Figure  3.2.2-5b  (with  (4.4-2),  the  solution  is 
unique). 

B  Update  the  gains  for  the  fcth  subcontroller  using  the  expressions  in  Figure  3.2.2-5a  and 
incorporate  these  within  the  closed-loop  system  model. 

C  Compute  the  overall  closed-loop  cost  J. 

2.  If  fc  <  Nt,  increment  fc  by  unity  and  go  to  step  1.  Otherwise,  increment  L  by  unity  and 
go  to  1. 

The  above  establishes  an  infinite  sequence  of  redesigns  and  a  corresponding  sequence  of  closed- 
loop  costs  { J(fc,  L);  fc  =  1, . . . ,  Nt,  L  =  1, . . . ,  oo).  It  is  easily  seen  that  J(k,  L )  is  monotonically 
nonincreasing.  This  occurs  because  step  l.A  is  the  solution  of  a  centralized,  fixed  order  optimization 
problem  and  the  value  of  J  cannot  increase  following  a  redesign.  Since  (J(fc,  L)}  is  a  monotonic 
nonincreasing  sequence  which  is  also  inherently  nonnegative,  it  converges  to  a  nonnegative  value. 
This  implies  also  that  the  sequence  of  subcontroller  gains  converge  and,  by  virtue  of  step  l.A, 
the  values  to  which  they  converge  satisfy  the  full  MEOP-MHC  design  equations.  This  solution 
can  be  shown  to  be  unique  and  corresponds  to  the  globally  optimal  design.  Thus,  under  the 
conditions  postulated,  the  above  general  algorithm  involving  sequential  redesign  and  directly  using 
the  homotopy  algorithm  for  centralized  MEOP  design  is  seen  to  converge  monotonically  to  the 
globally  optimal  design.  The  questions  raised  in  Figure  3. 2.2-3  are  answered  quite  satisfactorily 
and  the  overall  solution  (which  now  parallels  Figure  4.1-2  for  centralized  design)  is  seen  to  be 
practically  feasible  and  (thanks  to  the  homotopy  algorithm)  effective  and  efficient. 

The  above  results  also  follow  for  open-loop  unstable  systems  if,  in  the  above  algorithm,  one 
starts  by  first  designing  the  highest  level  controller  (the  supremal  coordinator)  to  stabilize  the 
system.  The  general  case  <  min {rnSt'3\l^x‘^')  has  not  been  extensively  investigated  and  must 
remain  the  object  of  further  research. 

Also,  note  that  the  sequential  redesign  algorithm  does  not  presuppose  any  particular  order  in 
which  the  subcontroller  redesigns  are  to  be  carried  out.  There  are  many  possibilities.  One  could, 
for  example  cycle  through  all  subcontrollers  in  some  order  within  a  given  iteration.  Alternatively, 
in  what  might  be  called  the  “echelon  scheme,”  one  might  iterate  only  the  compensator  designs  in 
a  given  hierarchical  level  (keeping  designs  in  other  levels  fixed)  until  there  is  convergence  for  that 
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level  and  then  move  on  to  another  hierarchical  level.  How  each  such  ordering  and  iteration  scheme 
affects  the  rate  of  convergence  is  just  beginning  to  be  appreciated.  Only  limited  design  experience 
has  been  acquired  to-date  and  much  remains  to  be  done  to  establish  the  ordering  of  the  sequential 
redesign  steps  which  will,  for  any  given  problem,  promote  the  most  rapid  convergence. 

4.3  Decentralized /Hierarchical  Design  Examples 

To  illustrate  the  ideas  developed  in  the  previous  sections,  we  have  carried  out  detailed  numerical 
calculations  for  two  design  problems.  The  first  example  involves  a  pair  of  interconnected  flexible 
beams  while  the  second  involves  a  deployable  truss  structure.  For  each  problem  a  decentralized 
controller  was  designed  using  the  sequential  design  algorithm  developed  in  the  previous  sections. 
Although  only  single  echelon  designs  were  considered,  the  extension  to  multiechelon  controllers  is 
straightforward. 

The  first  example  involves  a  pair  of  simply  supported  Euler-Bernoulli  flexible  beams  intercon¬ 
nected  by  a  spring  and  constrained  to  vibrate  in  one  spatial  dimension  (see  Figure  4.3-1  and  [76]). 
Each  beam  possesses  one  rate  sensor  and  one  force  actuator  which  are  noncolocated.  No  special 
requirements  were  imposed  on  the  locations  of  the  sensors,  actuators,  and  spring  attachment  points 
except  to  avoid  nodes  of  the  beam  mode  shapes.  Two  vibrational  modes  were  retained  in  each  beam 
so  that  the  interconnected  system  possesses  eight  poles.  The  interconnection  spring  was  chosen  to 
be  sufficiently  stiff  so  that  high  authority  local  decentralized  designs  designed  with  the  spring  absent 
suffered  significant  degradation  when  the  spring  was  reinserted.  To  obtain  high  authority  designs 
we  chose  quadratic  weights  so  that  the  closed-loop  performance  of  the  centralized  controller  yielded 
an  order  of  magnitude  performance  improvement  over  the  open-loop  system. 

To  design  a  decentralized  controller  we  began  by  designing  local  4th-order  decentralized  con¬ 
trollers  for  each  beam  individually.  Reinsertion  of  the  spring  resulted  (as  noted  above)  in  significant 
performance  degradation.  Each  subcontroller  was  then  redesigned  alternatively  yielding  the  results 
given  in  the  following  table: 
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Design  Cost 


Open  loop  163-5 

Centralized  LQG  ne  =  8  19-99 

Suboptimal  decentralized  nci  =  nc2  =  4  59-43 

Redesign  subcontroller  2  28-19 

Redesign  subcc  roller  1  23-29 

Redesign  subcontroller  2  23-C4 

Redesign  subcontroller  1  22-25 

Redesign  subcontroller  2  21-94 

Redesign  subcontroller  1  21-86 

Redesign  sub  controller  2  21-81 

Redesign  subcontroller  1  21-79 


It  is  immediately  evident  that  each  redesign  step  resulted  in  improved  performance  of  the 
decentralized  closed-loop  system.  As  noted  previously,  this  monotonic  improvement  is  a  direct 
result  of  the  fact  that  at  each  redesign  stage  a  suboptimal  subcontroller  is  being  replaced  by  a 
subcontroller  which  is  optimal  with  respect  to  the  augmented  plant  consisting  of  the  actual  plant 
and  remaining  subcontroller.  Finally,  note  that  since  each  subcontroller  involves  one  sensor  and 
one  actuator,  there  exists  at  most  one  solution  to  the  design  equations  at  each  redesign  step.  Thus 
the  sequence  converges  to  the  global  minimum  of  the  decentralized  design  problem. 

As  a  second  and  more  realistic  example  we  consider  the  decentralized  control  of  a  deployable 
truss  structure  (Figure  4.3-2).  Unlike  the  previous  example  this  structure  does  not  involve  phys¬ 
ically  identifiable  subsystems.  Rather,  the  motivation  for  a  decentralized  architecture  arises  from 
the  desire  to  minimize  real-time  communication  among  sensors  and  actuators  located  at  differ¬ 
ent  points  (bays)  along  the  structure.  Hence  we  consider  a  decentralized  feedback  architecture  in 
which  each  subcontroller  involves  only  sensors  and  actuators  located  within  a  single  bay.  Although 
subcontrollers  do  not  communicate  with  one  another  by  exchanging  data,  they  do  interact  via  the 
dynamics  of  the  structure.  Modal  data  for  the  first  10  modes  of  the  structure  are  given  in  Figure 
4.3-3  while  mode  shapes  are  shown  in  Figures  4.3-4,  4.3-5  and  4.3-6. 

In  designing  a  decentralized  feedback  architecture  we  considered  control  instrumentation  at 
bays  23,  46  and  54  (tip).  Specifically,  for  control  we  considered  rate  sensors  and  force  actuators 
at  bays  28,  46  and  54  .-long  the  x  and  y  axes  and  at  bay  54  about  the  z  axis.  Furthermore, 


BLSl 


Mode 

Mode  Frequency 

W 

Modal  Damping 

V 

Mode  Shape 

Description 

1 

0.179 

0.002 

1st  x-z  Bending 

2 

0.236 

0.002 

1st  y-z  Bending 

3 

1.270 

0.003 

2nd  y-z  Bending 

4 

1.320 

0.003 

2nd  x-z  Bending 

5 

1.460 

0.005 

1st  Torsion 

6 

3.640 

0.005 

3rd  y-z  Bending 

7 

3.800 

0.005 

3rd  x-z  Bending 

8 

5.180 

0.005 

2nd  Torsion 

9 

6.200 

0.005 

4th  y-z  Bending 

10 

6.410 

0.005 

4th  x-z  Bending 

I 


Figure  4.3-3.  Modal  Data  for  the  Deployable  Truss  Structure 
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«th  x-l  Bending,  f>  6.41  Hi 


Figure  4.3-4.  Deployable  Truss  Structure  Mode  Shapes 
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disturbances  were  assumed  to  be  generated  by  actuators  at  bay  10  (along  the  x  and  y  axes),  bay 

28  (about  the  z  axis),  and  bay  54  (along  the  x  and  y  axes  and  about  the  z  axis).  As  a  measure  of  I 

performance  we  considered  the  motion  of  the  tip  along  the  x  and  y  axes  and  about  the  x,  y  and 

z  axes.  Sensor  noise  levels  and  control  signal  weighting  matrices  were  chosen  so  that  a  centralized 

LQG  controller  reduced  mean-squared  variation  to  1%  of  their  open-loop  levels.  Note  that  such  an 

LQG  controller  is  of  20th  order  and  involves  feedback  loops  between  all  sensors  and  actuators.  ta 

To  produce  a  decentralized  controller  we  constrained  the  architecture  to  involve  three  subcon¬ 
trollers  involving  sensors  and  actuators  at  bays  28,  46  and  54  (see  Figure  4-3.7).  Each  subcontroller 
was  constrained  to  be  a  4th-order  compensator.  The  sequence  of  evaluations  and  refinements 
is  shown  in  Figure  4.3-8.  The  final  controller  consisting  of  three  4th-order  local  subcontrollers 
represented  only  an  8%  cost  degradation  compared  to  the  significantly  more  complex  20th-order 
centralized  LQG  design. 

i 
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Figure  4.3-7.  Control  System  Instrumentation  for  the 
Deployable  Truss  Structure 
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Procedure 

State  Cost 

Control  Cost 

Total 

Evaluate  Open  Loop  Cost 

429 

0 

429 

Design  LQG  Centralized  Controller  (n  =  20) 

2.97 

1.28 

4.25 

Design  LQG  Single  Channel  Controller  (ne  =  20) 
with  Bay  54  Instrumentation  Only 

3.08 

1.42 

4.50 

(I)  Design  OP  Single  Channel  Controller  (ne  =4) 
with  Bay  54  Instrumentation  Only 

5.94 

1.34 

7.28 

Design  LQG  Single  Channel  Controller  (ne  =  20) 
with  Bay  46  Instrumentation  Only 

10.2 

1.83 

12.0 

(II)  Design  OP  Single  Channel  Controller  (ne  =  4) 
with  Bay  46  Instrumentation  Only 

10.2 

1.97 

12.2 

Design  LQG  Single  Channel  Controller  (ne  =  20) 
with  Bay  28  Instrumentation  Only 

23.2 

6.26 

29.4 

(III)  Design  OP  Single  Channel  Controller  (ne  =  20) 
with  Bay  28  Instrumentation  Only 

23.3 

7.04 

30.3 

Evaluate  Performance  of  I  +  II  +  III 

N/A 

N/A 

10.9 

Evaluate  Performance  of  I  +  II 

N/A 

N/A 

7.72 

Redesign  II  (I  +  II') 

6.86 

1.80 

7.04 

Redesign  I  (I'  +  II') 

3.42 

1.36 

4.78 

Evaluate  (I'  +  II'  +  III) 

N/A 

N/A 

7.97 

Redesign  III  (I'  +  II'  +  IIP) 

4.63 

.034 

4.66 

Redesign  I  (I"  +  II'  +  III') 

3.26 

1.31 

4.57 

M 


Figure  4.3-8.  Sequential  Decentralized  Design  Procedure  for 
Deployable  Truss  Structure 
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Abstract 


OPUS  (Optimal  Projection  for  Uncertain  Systems)  provides  new  machinery  for 
designing  active  controllers  for  suppressing  vibration  in  flexible  structures.  The 
purpose  of  this  paper  is  to  review  this  machinery  and  demonstrate  its  practical  value 
in  addressing  the  structural  control  problem. 


1.  Introduction 


For  many  years  it  has  been  widely  recognized  that  the  desire  to  orbit 
large,  lightweight  space  structures  possessing  high-performance  capabilities  would 
require  active  feedback  control  techniques.  More  generally,  the  need  for  such 
techniques  nay  arise  due  to  the  combinations  of  either  1)  moderate  performance 
requirements  for  highly  flexible  structures  with  low-frequency  modes  or  2)  stringent 
performance  requirements  for  semi-rigid  structures  with  relatively  high-frequency 
modes  (Figure  1).  Applications  include  pointing,  slewing,  and  aperture  shape  control 
for  optical  and  RF  systems. 


'Small'  structures 

•  Older  generation  of  spacecraft 

•  Most  civil  engineering  structures 
(from  sliength.'stafic  loading 
point  of  view) 


CONTROLLER  AUTHORITY  AND  OR 
RESPONSE  RANGE  Of  INTEREST 


"Large  structures 

■  Highly  ffeubfe  spacecraft, 
tail  buildings  rapid  transit 
structures,  etc 

And/or 

■  Stringent  pointing  accuracy 
and  optical  quality 
requirements 

•  Noise  abatement  (acoustical/ 
structural  interaction) 


Figure  1,  The  Heed  for  Active  Structural  Control  Arises  From 
Stringent  Performance  Requirements  cr  Low-Frequency  Modes 
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DISTURBANCES 


Figure  2.  Vibration  Control  Systems  Utilise  Sensors,  Processors  and  Actuators 

to  Suppress  Disturbances 

The  problem  of  active  vibration  suppression  (Figure  2)  entails  the 
following  considerations: 

1.  Multiple,  highly  coupled  feedback  loops.  The  potentially  large  number  of 
senaors  and  actuators  leads  to  a  fully  coupled  mult j-input,  multi-output 
feedback  control  system. 

2.  Limited  actuator  power.  The  control  authority  available  from  on-board 
actuators  is  limited  by  weight,  size,  cost  and  power  considerations. 

3.  High-dimensional  models.  Large  st rvctvree  subjected  to  broadband 
disturbances  are  typically  represented  by  high-order  finite  element  models. 

4.  Limited  processor  capacity.  Reliability  and  cost  considerations  limit  the 
processor  capacity  available  for  on-board  real-time  implementation  of  the 
control  system. 

5.  Highly  uncertain  models  with  structured  uncertainty.  Finite  element  models 
often  exhibit  significant  error  particularly  as  modal  frequency  increases. 
Although  modal  testing  and  related  identification  methods  may  be  used  to 
improve  modeling  accuracy,  residual  uncertainty  always  remains  and 
unpredictable  on-orbit  changes  due  to  eging,  thermal  effects,  etc.,  must  be 
tolerated. 
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6.  Stringent  performance  requirements.  Since  active  space  structure  control 
is  most  relevant  in  precision  applications,  it  can  readily  be  expected  that 
performance  specifications  will  be  particularly  stringent, 

7.  Design  efficiency.  Because  of  implementation  complexity  due  to  the 
presence  of  multiple  loops,  high  dimension,  and  high  levels  of  uncertainty, 
the  control  design  approach  should  efficiently  utilize  both  synthesis  and 
analysis  techn jques  (Figure  3) . 


Figure  3.  Control-System  Design  Must  Efficiently  Utilize  Both 
Synthesis  and  Analysis  Techniques 

These  considerations  pose  a  considerable  challenge  to  the  state-of-the-art 
in  control-design  methodologies.  For  example,  the  presence  of  multiple,  coupled 
feedback  paths  essentially  precludes  the  effectiveness  of  single-loop  design 
techniques.  The  sheer  number  of  loops,  their  interaction,  and  the  need  to  address  a 
host  of  other  issues  render  such  methods  inefficient  and  unwieldy. 

In  addition  to  the  presence  of  multiple  loops,  the  high  dimensionality  of 
dynamic  models  places  a  severe  burden  on  cont rot-design  methodologies.  For  example, 
although  LQG  (linear-quadrat ic-Gaussien)  design  is  applicable  to  multi-loop  problems, 
such  controllers  are  of  the  same  order  as  the  structural  model  (Figures  A  and  5). 

Thus  LQG  and  similar  high-order  controllers  can  be  expected  to  place  an  unacceptable 
computat ional  burden  on  the  real-time  processing  capability.  Hence  it  is  not 
surprising  that  a  variety  of  techniques  have  been  proposed  to  reduce  the  order  of  LQG 
controllers.  A  comparison  of  several  such  methods  is  given  in  (l] . 

All  of  the  above  difficulties  are  severely  exacerbated  by  the  fact  that  the 
dynamic  (i.e.,  finite  element)  model  upon  which  the  control  design  is  predicated  may 
be  highly  inaccurate  in  spite  of  extensive  modal  identification.  Hence,  applicable 
control-design  methodologies  must  account  for  modeling  uncertainties  by  providing 
robust  (i.e.,  insensitive)  controllers.  Furthermore,  because  of  stringent 
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HIGH-ORDER  PLANT  «Rn 


J(Ac,Bc,Cc)  =  lim  E[xtRi*  +  utRju] 
I—  * 


Figure  A.  LQG  Theory  Addresses  the  Problem  of  Designing  a 
Quadrat ically  Optical,  Full-Order  Dynamic  Compensator 


FULL-ORDER  CONTROLLER  GAINS 

Ac  =  A  -  Ol  -  XP 

B,  =  QCtV_1 
c  2 

c.  =  -r-’b1? 
c  2 

SEPARATED  RICCATI  EQUATIONS 

0  =  AO  ♦  0At  ♦  V,  -  q£q  (Kalman  Filter) 

0  =  ATP  *  PA  *  Ri  -  PXP  (Regulator) 

iSBR-’B1,  Esc^Hc 
2  2 

Figure  5.  The  Optimal  Full-Order  (LQG)  Controller  Is  Determined  by  a 
Pair  of  Separated  Riccati  Equations 
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performance  requirements,  robust  control  design  must  avoid  conservat i sm  with  respect 
to  modeling  uncertainty  which  may  unnecessari ly  degrade  performance.  A  salient 
example  of  conservatism  is  illustrated  in  Figure  6.  If  uncertainty  in  the  modal 
frequency  is  complexified  in  a  transfer  function  setting,  then  the  resulting  pole 
location  uncertainty  has  the  form  of  a  disk.  This  disk,  however,  intersects  the 
right  half  plane  in  violation  of  energy  dissipation.  Hence  one  source  of 
conservatism  is  the  inability  to  d i f ferent iate  between  physically  distinct  parameters 
such  as  modal  frequency  and  modal  damping. 


Im  A 


■v' 


RIGHT-HALF-PLANE 
POLES  ARE  PHYSICALLY 
IMPOSSIBLE 


Re  A 


Figure  6.  Complexif icat ion  of  Real  Parameters  May  Lead  to  Robustness  Conservatism 

Although  classical  methods  are  inappropriate  for  vibration  control,  a  wide 
variety  of  modern  techniques  are  available.  These  include  both  multi-loop  frequency- 
domain  methods  and  time-domain  techniques.  A  comprehensive  review  of  such  methods 
will  not  be  attempted  here.  Rather,  we  shall  merely  point  out  aspects  of  several 
methods  which  motivate  the  philosophy  of  OPUS  development. 

As  is  well  known,  dynamic  models  can  be  transformed  (at  least  in  theory) 
between  the  frequency  and  time  domains.  Significant  differences  arise,  however,  in 
attempting  to  represent  modeling  errors.  Specifically,  model-error  characterization 
of  a  particular  type,  which  is  natural  and  tractable  in  one  domain,  may  become 
extremely  cumbersome  when  transformed  into  the  ether  domain.  For  example,  consider  a 
state  space  model  with  parameter  uncertaint ies  arising  in  the  system  matrices 
(A,B,C).  Upon  transforming  tc  a  frequency  domain  model  G(s)  =  C(sI-A)~*B  the 
parametric  uncertainties  may  perturb  the  transfer  function  coeffie'ents  in  a 
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complicated  manner.  A  more  natural  measure  of  uncertainty  for  transfer  functions  has 
been  developed  in  [2]  where  system  uncertainty  in  the  frequency  domain  is  modeled  by 
means  of  normed  neighborhoods  in  the  H-infinity  topology.  There  are  limitations  with 
this  approach,  however,  in  designing  controllers  for  vibration  suppression.  For 
example,  as  shown  in  Figure  6,  complexif icat ion  of  real-parameter  uncertainties  such 
as  modal  frequencies  may  yield  unnecessary  conservatism,  while  norm  bounds  often  foil 
to  preserve  the  physical  structure  of  parameter  variations.  A  case  in  point  is  the 
lightly  damped  oscillator.  As  shown  in  [A42J,  norm  bounds  predict  stability  over  a 
frequency  range  on  the  order  of  the  damping  while  in  fact  the  oscillator  is 
unconditionally  stable.  Furthermore,  with  regard  to  processor  throughput  tradeoffs, 
modern  frequency-domain  methods  typically  yield  high-order  controllers. 

Although  LQC  addresses  performance/actuator  end  performance/ sensor 
tradeoffs  in  a  multi-loop  setting,  it  fails  to  incorporate  modeling  uncertainty. 

Thus  it  is  not  surprising,  as  shown  in  (3],  that  LQC  designs  fail  to  possess 
guaranteed  gain  margin.  Since  LQC  designs  lack  such  margins,  attempts  have  been  made 
to  apply  frequency-domain  techniques  to  improve  their  characteristics.  One  such 
method,  known  as  LQC/LTR  ([4,5])  seeks  to  recover  the  gain  margin  of  full-state- 
feedbock  controllers.  Specifically,  full-state-f eedbock  LQR  controllers  are 
guaranteed  to  remain  stable  in  the  face  of  perturbations  of  the  input  matrix  B  of  the 
form  orB  where  or«[l/2.«).  As  shown  in  [6,7],  however,  the  full-state-feedback  gain 

margin  fails  to  provide  robustness  with  respect  to  perturbations  which  are  not  of 

T 

this  form.  For  instance,  the  example  given  in  [6]  with  B  =  [0  1]  can  be 

T 

destabilized  for  suitable  performance  weightings  with  perturbation  B(E)  =  [E  1]  for 
arbitrarily  small  E  in  spite  of  the  6  dB  margin.  Furthermore,  since  LQC/LTR  loop 
shaping  is  based  upon  singular  value  norm  bounds,  treatment  of  physically  meaningful 
reel  parameter  variations  may  lead  to  unnecessary  conservatism.  Several  approaches 
have  been  proposed  for  circumventing  these  difficulties  (see,  e.g.,  [8]). 

The  importance  of  addressing  the  problem  of  structured  uncertainty  in 
finite  element  models  cannot  be  overemphasized.  Structural  characteristics  such  as 
modal  frequencies,  damping  ratios,  and  mode  shapes  appear  explicitly  in  (A,B,C) 
state-space  models  as  physically  meaningful  parameters.  Uncertainty  in  mode  shapes, 
for  example,  which  appear  as  columns  of  the  B  matrix,  cannot  in  general  be  expected 
to  be  of  a  multiplicative  form  in  accordance  with  traditional  gain-margin 
specifications.  This  is  precisely  the  problem  illustrated  by  the  example  of  [6] 
discussed  above.  Furthermore,  uncertainties  in  modal  frequencies  and  damping  ratios 
must  be  carefully  differentiated  since,  roughly  speaking,  modal  frequency 
uncertainties  affect  only  the  imaginary  part  of  the  pole  location  vhile  damping 
uncertainty  affects  the  real  part.  Although  these  and  related  observations 


concerning  uncertainty  in  the  dynamic  characteriaticc  of  lightly  damped  structures 
may  be  self  evident,  they  have  remained  largely  unexploited  in  standard  control- 
design  methods. 


2.  OPUS:  New  Machinery  for  Control-System  Design 

In  view  of  the  ability  of  LQC  theory  to  synthesize  dynamic  controllers  for 
aiultl-input,  multi-output  controllers,  it  is  not  surprising  that  LQG  fores  the  basis 
for  a  variety  of  structural  control  methods.  However,  as  discussed  previously.  LQG 
lacks  the  ability  to  address  performance/processor  and  performance/ robustness 
tradeoffs.  This  situation  has  thus  motivated  the  development  of  numerous  variants  of 
LQG  which  entail  additional  procedures  which  attempt  to  remedy  these  defects.  OPUS, 
however,  is  distinctly  different.  Rather  than  append  additional  procedures  to  LQG 
design,  OPUS  extends  LQG  theory  itself  by  generalizing  the  basic  underlying 
machinery. 


As  shown  in  Figure  5,  the  basic  machinery  of  LQG  consists  of  s  pair  of 
separated  Riccati  equations  whose  solutions  serve  to  directly  and  explicitly 
synthesize  the  gains  of  an  optimal  dynamic  compensator.  The  contribution  of  OPUS  is 
to  directly  expand  this  machinery.  The  overall  approach  is  illustrated  in  Figure  7 
which  portrays  two  distinct  generalizations  of  the  basic  LQG  machinery.  As  Figure  7 
illustrates,  thece  generalizations  can  be  developed  individually  when  either  low- 
order  or  robust  controllers  are  desired.  The  appealing  aspect  of  OPUS,  however,  is 
the  ability  to  extend  LQC  to  address  both  problems  simultaneously  in  a  unified 
manner. 


Figure  7.  The  Standard  LQG  Result  Is  Generalized  by  Both  the  Fixed-Order 
Constraint  and  Modeling  of  Parameter  Uncertainties 
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In  the  following  lections  the  generalizations  depicted  in  Figure  7  will  be 
reviewed  following  the  left  branch.  That  is,  the  optimal  projection  approach  to 
reduced-order  controller  design  will  first  be  discussed  in  Section  3  without 
introducing  plant  uncertainties.  In  Section  4  the  reduced-order  constraint  will  be 
retained  while  considering,  in  addition,  uncertainties  in  the  system  model.  In  each 
case  the  discussion  will  focus  on  the  underlying  ideas  with  a  minimum  of  technical 
detail. 


Clearly,  in  order  for  a  novel  design  methodology  to  be  of  practical  value 
it  must  be  coaiputationally  tractable.  Hence  Section  5  will  present  an  overview  of 
the  current  state  of  algorithm  development  for  solving  the  OPUS  design  equations. 
Finally,  Section  6  will  briefly  susmiarize  further  OPUS  generalizations  of  LQC  theory 
which  are  relevant  to  structural  control. 


I 


3. 


Extensions  of  LQG  to  Reduced-Order  Dynamic  Compensation 


The  simplest,  most  direct  way  to  obtain  optimal  reduced-order  controllers 
is  to  redevelop  the  standard  LQC  result  in  the  presence  of  a  constraint  on  controller 
dimension  (Figure  8).  The  mathematical  technique  required  to  do  this  is  remarkably 
straightforward.  Specifically,  the  structure  and  order  of  the  controller  are  fixed 
and  the  performance  is  optimized  with  respect  to  the  controller  gains.  The  resulting 
necessary  conditions  obtained  using  Lagrange  multipliers  thus  characterize  the 
optimal  gains. 


HIGH-ORDER  PLANT  x.Rn 


STEADY-STATE  PERFORMANCE  CRITERION 

J(Ac,Bc,Cc)  =  llm  El*^!*  ♦  utR2«] 

1  —  00 

Figure  8.  In  Accordance  Uith  On-Board  Processor  Requirements,  a  Reduced-Order 
Constraint  Is  Imposed  on  the  Dimension  of  the  Dynamic  Compensator 
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This  parameter  optimization  approach  as  such  is  not  new  and  was 
investigated  extensively  in  the  1970's.  Typically,  however,  the  optimality 
conditions  were  found  to  be  conplex  and  unwieldy  while  offering  little  insight  and 
requiring  gradient  search  methods  for  numerical  solution. 

One  curious  aspect  of  the  parameter  optimization  literature  is  that  no 
attempt  was  made  to  actually  use  this  direct  method  to  rederive  the  LQC  result 
itself.  Such  an  exercise,  it  may  be  surmised,  might  reveal  hidden  structure  within 
the  optimality  conditions  which  would  shed  light  on  the  reduced-order  case.  Indeed, 
such  an  approach  led  to  the  realization  that  an  oblique  projection  (idempotent 
matrix)  is  the  key  to  unlocking  the  unwieldy  optimality  conditions  ([A7.A17]). 
Although  the  result  is  mathematically  straightforward,  it  is  by  no  means  obvious 
since  in  the  full-order  (LQC)  case  the  projection  is  the  identity  and  hence  not 
readily  apparent. 

By  exploiting  the  presence  of  the  projection,  the  necessary  conditions  can 
be  transformed  into  a  coupled  system  of  four  algebraic  matrix  equations  consisting  of 
a  pair  of  modified  Riccati  equations  and  a  pair  of  modified  Lyapunov  equations 
(Figure  9).  The  coupling  is  via  the  oblique  projection  r  which  appears  in  all  four 
equations  and  which  is  determined  by  the  solutions  Q  and  P  of  the  modified  Lyapunov 
equations.  A  satisfying  feature  of  the  optimality  conditions  is  that  in  the  full- 
order  case  the  projection  becoaes  the  identity,  the  modified  Lyapunov  equations  drop 
out,  and,  since  «  0.  the  modified  Riccati  equations  specialize  to  the  usual 
separated  Riccati  equations  of  LQC  theory.  Since,  furthermore,  C  =  T  *  nxn  identity, 
the  standard  LQC  gain  expressions  are  recovered. 

Although  the  modified  Riccati  equations  specialize  to  the  standard  Riccati 
equations  in  the  full-order  case,  the  modified  Lyapunov  equations  have  no  counterpart 
in  the  standard  theory.  The  role  of  these  equations  can  be  understood  by  considering 
the  problem  of  optimal  model  reduction  alone.  For  this  problem  the  optimal  reduced- 
order  model  is  characterized  by  a  pair  of  coupled  modified  Lyapunov  equations 
(see  (A22] ) .  Thus  the  modified  Lyapunov  equations  arising  in  the  reduced-order 
dynamic-compensation  problem  are  directly  analogous  to  the  modified  Lyapunov 
equations  arising  in  model  reduction  alone.  The  modified  Lyapunov  equations  arising 
in  the  control  problem,  however,  are  intimately  coupled  with  the  modified  Riccati 
equations.  Hence  it  cannot  be  expected  that  reduced-order  control-design  techniques 
based  upon  LQG  will  generally  yield  optimal  fixed-order  controllers  (Figure  10).  It 
is  interesting  to  note  that  several  such  methods  discussed  in  [1]  are  based  upon 
balancing  which  was  shown  in  (A22)  to  be  suboptimal  with  respect  to  the  quadratic 
(least  squares)  optimality  criterion. 
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REDUCED-ORDER  CONTROLLER  GAINS 

Ac  s  !'(A-Qi-IP)GT 
Bc  s  IXtCTVj’ 

Cc  s  -R',1B7PGT 

COUPLED  RICCATI/LYAPUNOV  EQUATIONS 

0  =  AO  ♦  QAT  ♦  V,  -  QIQ  *  r.QIQr7 
0  =  A7P  ♦  PA  ♦  R,  -  PIP  ♦  tt,PIPt1 
0  —  (A-IP)Q  ♦  Q{A-IP)7  +  OIQ  -  i^OlOr7 
0  =  (A-Ol)7P  +  P(A-OI)  ♦  PIP  -  rTpIPr, 

rank  6  -  rank  P  =  rank  OP  =  nc 
OP  s  GTMf  IG7  —  l„e 

r  =  GTf  =  QP(QP)»  r,  =  l„  -  r 

I  =  BR,'V  i  =  C7V,’C 

Figure  9.  The  Opr  leal  Reduced-Order  Compensator  Is  Determined  by  a 
Pair  of  Modified  Riccati  Equations  and  a  Pair  of  Modified  Lyapunov  Equations 
Coupled  by  the  Oblique  Projection T 


Figure  10.  The  Optimal  Projection  Equations  Provide  s  Direct  Path  to 
Optimal  Reduced-Order  Dynamic  Compensators 
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In  summary,  the  optimal  projection  equations  for  reduced-order  dynamic 
compensation  comprise  a  direct  extension  of  the  basic  LQG  machinery  to  the  reduced- 
order  control  problem.  The  design  equations,  which  reduce  to  the  standard  LQC  result 
in  the  full-order  case,  provide  direct  synthesis  of  optimal  reduced-order  controllers 
in  accordance  with  implementation  constraints. 


4.  Extensions  of  LQC  to  Uncertain  Modeling 

Two  fundamental  sources  of  error  in  modeling  flexible  structures  are 
truncated  modes  and  parameter  uncertainties.  Since  the  optimal  projection  approach 
permits  the  utilization  of  the  full  dynamics  model,  modal  truncation  can  be  largely 
avoided.  There  remains,  however,  a  tendency  to  truncate  poorly  known  modes  and  thus 
it  is  essential  to  incorporate  a  model  of  parameter  uncertainty  in  both  well-known 
and  poorly  known  components  of  the  system.  Hence  the  problem  formulation  of  Figure  8 
is  now  generalized  in  Figure  11  to  include  uncertain  parameters  cr.  appearing  in  the 
A,  B  and  C  matrices.  The  parameter  <r.  is  assumed  to  lie  within  the  interval  [-Sj.Sj] 
in  accordance  with  identification  accuracy.  Clearly,  when  uncertainty  is  absent, 
i.e.,  when  A..  Bj,  C.  =  0,  the  reduced-order  design  problem  of  Figure  8  is  recovered. 

HIGH-ORDER,  UNCERTAIN  PLANT 

s  Stochastic  disturbance  model 
a  Deterministic  parameter  uncertainty  model 


|  oj  |  <  <5| 


■  Dynamic  (strictly  proper) 

■  Static  (constant  gain) 

■  Dynamic/static  (nonstrictly  proper) 

Figure  11.  Robust  Optimal  Projection  Design  Is  Based  Upon  a 
Hybrid  Uncertainty  Model  Involving  a  Deterministic  Parameter  Uncertainty  Model 
and  a  Stochastic  Disturbance  Model 
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A  salient  feature  of  the  design  model  is  that  uncertainty  is  modeled  in  two 
distinctly  different  ways.  External  uncertainty  appearing  as  additive  white  noise  is 
modeled  at oc hast ically .  Such  a  model  appears  appropriate  for  disturbances  such  as 
coolant  flow  for  which  only  power  spectral  data  are  available.  On  the  other  hand, 
internal  uncertainty  appearing  as  parameter  variations  is  modeled  deterministically. 
Such  a  model  appears  appropriate  for  uncertainty  arising  from  directly  measurable 
quantities  such  as  mass  and  stiffness.  Thus  the  overall  uncertainty  model  is  hybrid 
in  the  sense  that  it  utilizes  both  deterministic  and  stochastic  characterizations  of 
uncertainty. 

A  natural  performance  measure  which  accounts  for  both  types  of  uncertainty 
characterization  involves  the  usual  LQC  quadratic  criterion  averaged  over  the 
disturbance  statistics  and  then  maximized  over  the  uncertain  parameters  (Figure  12). 
Hence  this  performance  measure  incorporates  on  the  average  and  worst  case  aspects  in 
accordance  with  physical  considerations. 


PERFORMANCE  CRITERION 
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ROBUST  PERFORMANCE  PROBLEM 

Minimize  J(Ac,Bc,Cc)  over  the  class  of  robustly 
stabilizing  controllers  (Ac,Bc,Cc) 


Figure  12.  Performance  I.  Defined  To  Be  Worst  Case  Over  the  Uncertain  Parametera 
and  Average  Over  the  Diaturbance  Statiaticc 


The  resulting  Robust  Performance  Problem  thu#  involves  determining  the 
gaina  (Ae,Bc,Cc)  to  minimize  the  performance  J.  The  static  gain  D^  can  also  be 
included  but  mill  not  be  diacuaaed  here.  Despite  the  apparent  complexity  of  the 
problem,  remarkably  simple  techniques  can  be  used.  Specifically,  first  note  that 
after  taking  the  expected  value  the  performance  J  has  the  form 

J  ( A  ,  B  ,  C  )  =  sup  lim  sup  tr  Q(t)R, 

C  C  C  t->« 


(A.  1) 
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where  "tr"  denotes  trace  of  a  matrix.  Q(t)  is  the  covariance  of  the  clo6ed-loop 
system,  and  R  is  an  augmented  weighting  matrix  composed  of  R^,  and  R^.  The 

covariance  Q(t)  satisfies  the  standard  Lyapunov  differential  equation 

Q  =  (A+£«rA.)Q  +  Q(A+£o-.A.)T  +  V.  (4.2) 

where  A  is  the  closed-loop  dynamics.  A.  is  composed  of  A..  B.  and  C.,  and  V  is  the 
intensity  of  external  disturbances  for  the  closed-loop  system  including  the  plant  and 
measurement  noise. 

Two  distinct  approaches  to  this  problem  will  be  considered.  The  first 
involves  bounding  the  performance  over  the  class  of  parameter  uncertainties  and  then 
choosing  the  gains  to  minimize  the  bound.  Since  bounding  precedes  control  design 
this  approach  is  known  as  robust  design  via  a  priori  performance  bounds.  The  second 
approach  involves  exploiting  the  nondestabilizing  nature  of  structural  systems  via 
weak  subsystem  interaction. 

4. I  Robust  Design  Via  A  Priori  Performance  Bounds 

The  key  step  in  bounding  the  performance  (4.1)  is  to  replace  (4.2)  by  a 
modified  Lyapunov  differential  equation  of  the  form 


g  =  Ag  +  g^  +  +(g)  ♦  v. 


where  the  bound  *  satisfies  the  inequality 

(A.g+gAT)  <  +(g) 


(4.3) 


(4.4) 


over  the  range  of  uncertain  parameters  cr.  and  for  all  candidate  feedback  gains.  Note 
that  the  inequality  (4.4)  is  defined  in  the  sense  of  nonnegative-definite  matrices. 
Now  rewrite  (4.3)  by  appropriate  addition  and  subtraction  as 


g  =  (A+£>.A.)g  ♦  g(A+£<r.A.)T+  +(g)  -  £>i(A.g4gA'?)  +  v. 
Now  subtract  (4.2)  from  (4.5)  to  obtain 


(4.5) 


2  -  Q  =  (A+^o-.AjKg-Q)  +  (9-Q)(a+£>.a.)t  +  *(g)  -  • 


> 


f 


(4.6) 
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Since  by  (4.4)  the  term 


*(<J)  -  E^A.Q+Sa!)  (4.7) 

is  nonnegative  definite*  it  follows  immediately  that 

Q  £  2  (A. 8) 

over  the  class  of  uncertain  parameters.  Thus  the  performance  (A.l)  can  be  bounded  by 

J (A  ,B  ,C  )  <  J (A  ,B  ,C  )  -  lim  tr  OR.  (4.9) 

ccc  —  —  ccc  t->«* 

The  auxiliary  coat  J  is  thus  guaranteed  to  bound  the  actual  cost  J.  This  leads  to 
the  Auxiliary  Minimisation  Problem:  Minimize  the  auxiliary  cost  J  over  the 
controller  gains.  The  advantage  of  this  approach  is  that  necessary  conditions  for 
the  Auxiliary  Minimization  Problem  effectively  serve  as  sufficient  conditions  for 
robust  performance  in  the  original  problem.  Since  the  bounding  step  precedes  the 
optimization  procedure,  this  approach  is  referred  to  as  robust  design  via  a  priori 
performance  bounda.  This  procedure  is  philosophically  similar  to  guaranteed  cost 
control  ([9.10]).  Note  that  since  bounding  precedes  optimization,  the  bound  (4.4) 
must  hold  for  all  gains  since  the  optimal  gains  are  yet  to  be  determined. 

To  obtain  sufficient  conditions  for  robust  stability,  the  bounding  function 
♦  must  be  specified.  Since  the  ordering  of  nonnegative-definite  matrices  appearing 
in  (4.4)  is  not  a  total  ordering,  a  unique  lowest  bound  should  not  be  expected. 
Furthermore,  each  differentiable  bound  leads  to  a  fundamental  extension  of  the 
optimal  projection  equations  and  thus  of  the  basic  LQC  machinery.  In  worfc  thus  far, 
two  bounds  have  been  extensively  investigated.  Only  one  bound,  the  right 
shif t/mult ipl icar ive  white  noise  bound,  will  be  discussed  here.  The  structured 
stability  radius  bound  introduced  in  [11,12]  is  discussed  in  [A43]. 

The  right  shift/multiplicarive  white  noise  bound  investigated  in  [A29.A41] 
is  given  by 

*(2)  =  Es.^g+oCVgA!),  (4.10) 

where  a.  >  0  are  arbitrary  scalars.  Note  that  this  bound  consists  of  two  distinct 

parts  which  must  appear  in  an  appropriate  ratio.  The  first  term  a.Q  arises  naturally 

a.  t 

when  an  exponential  time  weighting  e  is  included  in  the  performance  measure.  As 
ia  well  kncwn  ([13])  this  leads  to  a  prescribed  uniform  stability  margin  for  the 
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cloeed-loop  system  (Figure  13).  A  uni  onn  stability  margin,  no  marter  how  large, 

however,  does  not  guarantee  robustness  with  respect  to  arbitrary  parameter 

-1“  — T 

variations.  The  complementary  second  term  a.  A.J|A.  is  crucial  in  this  regard. 


x  =  Ax  <♦  x  =  {A  +  al)x,  a  >  0 

lm 


APPLY  CONTROL-DESIGN  TECHNIQUES 
TO  RIGHT-SHIFTED  OPEN-LOOP  SYSTEM 
O  UNIFORM  STABILITY  MARGIN 
(Anderson  and  Moore,  1969) 


Figure  13.  Open-Loop  Right-Shifted  Dynamics  Arising  Fro.  Exponential  Coat  Weighting 
Lead  to  a  Uniform  Closed-Loop  Stability  Margin 


Although  terms  of  the  form  A.()Aj  are  unfamiliar  in  robust  control  design, 
they  arise  naturally  in  stochastic  differential  equations  with  multiplicative  white 
noise.  That  is.  if  the  uncertain  parameters  (T,  are  rep  1  seed  by  white  noise  processes 

entering  mult ipl icat ively  rather  than  addirively,  then  the  covariance  equation  for  Q 

”  — T 

automatically  includes  terms  of  the  form  A.QA. .  The  literature  on  systems  with 
multiplicative  white  noise  is  quite  extensive;  see  [A36I  for  references.  It  should 
be  stressed,  however,  that  for  our  purposes  the  multiplicative  white  noise  model  is 
not  interpreted  literally  as  having  physical  significance.  Rather,  multiplicative 
white  noise  can  be  thought  of  os  a  useful  decign  model  which  correctly  captures  the 
impact  of  mcertainty  on  the  performance  functional  via  the  state  covariance. 
Furthermore,  just  as  the  right  shift  term  alone  does  not  guarantee  robustness, 
neither  does  the  multiplicative  white  noise  term.  Both  terms  must  appear 
simultaneously.  Roughly  speaking,  since  multiplicative  white  noise  disturbs  the 
plant  though  uncertain  parameters,  the  closed-loop  system  is  automatically 
desensitized  to  actual  parameter  variations. 


« 
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After  incorporating  the  right  chi f r/mulr i pi icaf ive  white  noise  bound  (A. 10) 
into  (A. 3)  to  obtain  ■  bound  J  for  the  performance,  the  optimal  projection  equations 
can  be  rederived  following  exactly  the  same  parameter  optimization  procedure 
discussed  in  Section  3.  Again,  the  mathematics  required  is  but  a  straightforward 
application  of  Lagrange  multipliers.  The  additional  bounding  terms  are  carried 
through  the  derivation  to  yield  a  direct  generalization  of  the  optimal  projection 
equations  shown  in  Figure  IA  with  gains  given  in  Figure  15. 


0  =  Ato  ♦  qa ^  ♦  aqat  ♦  v,  ♦  (Ai«n*21$r#)Q{A-Bn‘ii  |)T  -  o,v 
o  =  a\p  *  PAt  ♦  ATPA  ♦  R,  ♦  (A-0tVj|>.)TP(<-v'tV'2,tl)  -  i’jRjV'*  +  Tjr,  IR  2s,,*ri 
0  =  (A.-B.R-^VQ  ♦  Q{A,-B,R-1tF,)T  ♦  0,v£cT,-  ^V^t* 


o  =  (S^V'Jc/p  ♦  P(A,-CtV*2,C$)  ♦  TJ r\n2tP 

Figure  1A.  The  Robustified  Optimal  Projection  Design  Equations  Account  for  Both 
Reduced-Order  Dynamic  Compensation  and  Parametric  Uncertainty 
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Figure  15.  The  OPUS  Controller  Cains  Are  Qrplicitly  Characterized  as  a 
Direct  Generalisation  of  the  Classical  LQG  Gains 


The  robust i  f  ied  optimal  projection  equations  comprise  a  system  of  four 
matrix  equations  coupled  by  both  the  optimal  projection  and  uncertainty  terms.  When 
the  uncertainty  terms  are  absent,  the  optimal  projection  equations  of  Figure  9  are 
immediately  recovered.  On  the  other  hand,  if  the  order  of  the  controller  is  set 
equal  to  the  order  of  the  plant,  then  all  terms  involving  con  be  deleted. 

However,  in  this  case  the  modified  Lyapunov  equations  do  nor  drop  out  since  Q  and  P 
still  appear  in  the  modified  Riccati  equations.  Hence  the  basic  machinery  of  LQC  is 
again  extended  to  include  a  pair  of  Lyapunov  equations  coupled  to  a  generalization  of 
the  standard  LQC  equations.  It  is  interesting  to  note  that  a  related  result  in  the 
context  of  multiplicative  noise  also  appeared  in  the  Soviet  literature  ([14]).  It 
should  also  be  pointed  out  that  although  the  modified  Lyapunov  equations  arising  in 
the  reduced-order  control-design  problem  hove  analogues  in  model  reduction,  the 
modified  Lyapunov  equations  appearing  in  the  full-order  robustified  equations 
represent  new  machinery  not  anticipated  in  robustness  theories.  Hence  using 
straightforward  mathematical  techniques,  the  basic  LQC  machinery  has  again  been 
extended  in  novel  directions. 

Solving  the  design  equations  shown  in  Figures  14  and  15  yields  controllers 
with  guaranteed  levels  of  robustness.  The  actual  robustness  levels  may,  however,  be 
larger  than  specified  by  a  priori  bounds.  Thus,  to  achieve  desired  robust j ficat ion 
levels  for  the  uncertainty  structure  specified  by  the  a  priori  bounds,  the  design 
procedure  may  be  utilized  within  an  iterative  synthesi s/analysis  procedure 
(Figure  16). 


SYNTHESIS 


Figure  16,  Optimal  Projection/Guaranteed  Cost  Control  Provides 
Direct  Synthesis  of  Robust  Dynamic  Compensators 

4. 2  Robust  Design  Via  Weak  Subsystem  Interaction 

The  mechanism  by  which  LQC  was  robuctified  in  Section  4,t  involved  bounding 
the  performance  over  the  class  of  parameter  uncertainties  and  then  determining 
optimal  controller  gains  for  the  performance  bound.  As  discussed  in  Section  2, 
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however,  flexible  structures  possess  special  properties  which  may,  in  addition,  be 
exploited  to  achieve  robustness.  Specifically,  aside  from  rigid-body  modes,  energy 
dissipation  implies  that  mechanical  structures  are  open-loop  stable  regardless  of  the 
level  of  uncertainty.  That  is,  flexible  structures  possess  only  nondestab il ixinp, 
uncertainties.  Hence,  in  the  closed  loop,  a  given  controller  may  or  may  not  render  a 
particular  uncertainty  destabilizing.  A  priori  bounds  on  controller  performance 
must,  however,  be  valid  for  all  gains  since  bounding  precedes  optimization.  Hence,  a 
priori  bounding  may  in  certain  cases  fail  to  exploit  nondesrabi 1 izing  uncertainties. 

A  familiar  example  of  a  nondestabilizing  uncertainty  involves  uncertain 
modal  frequencies.  Such  an  uncertainty  will  nor,  of  course,  destabilize  an 
uncontrolled  (open— loop)  structure.  If  particular  modal  frequencies  are  poorly  known 
then  it  is  clearly  advisable  to  ovoid  applying  high  authority  control.  Hence,  rather 
than  the  right-shift  approach  of  Figure  13,  it  appears  advantageous  (although,  at 
first,  counterintuitive)  to  utilize  just  the  opposite,  namely,  a  1  eft  shift 
(Figure  17).  Furthermore,  in  view  of  the  fact  that  uncertainty  usually  increases 
with  modal  frequency  (Figure  18),  a  varioble  left  shift  appears  to  be  more 
appropriate  than  a  uniform  left  shift.  By  left-shifting  high-frequency  poorly  known 
modes,  the  control -system  design  procedure  applies  correspondingly  reduced  authority 
to  modes  "perceived"  as  highly  damped.  Hence  the  variable  left  shift  can  be  roughly 
thought  of  as  s  device  for  achieving  suitable  authority  rolloff.  As  will  be  ccen, 
however,  the  underlying  robust i ficar ion  mechanism,  namely,  weak  subsystem  interaction, 
is  for  more  subtle  than  the  approach  of  classical  rolloff  techniques.  It  is  also 
interesting  to  note  that  the  weak  subsystem  interaction  approach  to  robustness  is 
entirely  distinct  from  classical  robustness  approaches  which  utilize  high  loop  gain 
to  reduce  sensitivity. 
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Figure  17.  A  Variable  Left  Shift  Exploits  Open— Loop  Nondestebilizing  Uncertainties 


MODAL  FREQUENCY 
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Figure  18.  Modal  Uncertainty  Generally  Increases  With  Frequency 

A  variable  left  shift  can  readily  be  introduced  into  the  robustified 
optimal  projection  design  equations  by  replacing  A  by 

AB  =  A  ♦  £>?.  <*.u> 

where  denotes  the  structure  of  modal  frequency  uncertainty  (Figure  19).  Host 
interestingly,  such  a  modification  of  the  dynamics  matrix  arises  naturally  from  a 
multiplicative  white  noise  model  defined  not  in  the  usual  Ito  sense  but  rather  in  the 
sense  of  Stratonovich.  Thus,  as  in  the  a  priori  bounding  approach,  a  stochastic 


t=>  A  +  « - ►  Variable  Lelt  Shift 


Figure  19.  For  Modal  Systems  With  Frequency  Uncertainty 
the  Stratonovich  Correction  Corresponds  to  a  Variable  Left  Shift 
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model  serves  to  suggest  a  mechanise  for  robust j ficat ion  (Figure  20).  Again  it  is 
important  to  stress  that  the  multiplicative  white  noi6e  model  is  not  interpreted 
literally  as  having  physical  significance,  but  rather  can  be  thought  of  bo  b  useful 
design  aodel  which  correctly  captures  the  iapact  of  uncertainty  on  the  performance 
functional  via  the  state  covariance. 
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STOCHASTIC  UNCERTAINTY  MODELS 

Figure  20.  Stochastic  Models  and  Robustness  Bounds  Are  Fundament ally  Related 


In  earlier  work  the  Stratonovich  dynamics  model  was  justified  by  means  of 
the  minimum  in  format ion/maaimum  entropy  approach  ([A1-A15J).  A  central  result  of  the 
maximum  entropy  approach  is  that  the  high  authority/low  authority  transition  of  a 
vibration  control  system  from  well-known  low-frequency  modes  to  poorly  known  high- 
frequency  modes  (Figure  18)  is  directly  reflected  in  the  structure  of  the  6fate 
covariance  matrix  (Figure  21).  A  full-state  feedback  design  applied  to  a  simply 
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Figure  21.  Frequency  Uncertainties  in  the  Stratonovich  Model  Lead  to 
Suppressed  Cross  Correlation  in  the  Sresdy-State  Covariance 
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supported  bean  illustrates  this  point  (Figure  22).  By  assuming  that  uncertainty  in 
nodal  frequencies  increases  linearly  with  frequency,  the  structure  of  the  covariance 
matrix  leads  directly  to  the  control  gains  illustrated  in  Figure  23.  Note  that  in 
the  high-f requency  region  the  position  gains  are  essentially  zero  and  thus  the 
control  law  approaches  positive-real  energy  dissipative  rate  feedback.  This,  of 
course,  is  precisely  the  type  of  structural  controller  expected  in  the  presence  of 
poor  modeling  information.  Of  course,  any  effective  control -design  theory  for  active 
vibration  suppression  in  flexible  structures  should  produce  energy  dissipative 
controllers  when  structural  modeling  information  is  highly  uncertain. 
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Figure  22.  The  Effects  of  Frequency  Uncertainties  Can  Be  Illustrated 
for  a  One-Dimensional  Beam  With  Idealized  Full-State  Feedback 


To  carry  out  robust  if ied  optimal  projection  design  in  the  presence  of  left- 
shifted  open-loop  dynamics,  it  is  only  necessary  to  utilize  the  left-shifted  dynamics 
matrix  (A. 11)  in  place  of  the  right-shifted  marrix.  All  of  the  robuatified  optimal 
projection  machinery,  including  gain  expressions,  can  be  utilized  directly.  It  is 

also  important  to  stress  that  the  left  shift  must  be  used  in  conjunction  with  terms 
**  — T 

of  the  form  A.QA.. 

i  i 

One  explanation  for  the  mechanism  by  which  robust ificat ion  is  achieved  is 
illustrated  in  Figure  2A.  By  left  shifting  the  open-loop  dynamics  within  the  design 
process,  the  compensator  poles  are  similarly  lef t-shi f ted.  Thus  the  compensator 
pole&  are  effectively  moved  further  into  the  left  half  plane  away  from  the  actual 
plant  poles.  Since  the  interaction  between  compensator  and  plant  polos  is  weakened, 
the  closed-loop  system  is  correspondingly  robustified  with  respect  to  uncortaint iee 
in  the  plant  pole  locations.  A  sensitivity  analysis  of  this  mechanism  utilizing  a 
uniform  left  shift  in  the  context  of  LQG  design  is  given  in  115). 
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Figure  23.  The  Maximum  Entropy  Controller  Approaches  Rate  Feedback  in  the 
Limit  of  Poor  Modeling  Information  (High  Uncertainty) 


t  *  1  cOLOG 


Plant/ Compensator 
lubtyilimi 


Subsystem  interaction* 

0<  c  <  1 


poles  near  plant  pole* 
c£>  O(r)  shift  (strong  interaction) 


Wider  separation 

e£>  Off2)  shift  (weak  Interaction) 


c=C>  Decreased  sensitivity  to 
plant  variations 


Figure  24.  The  Stratonovich  Variable  Left-Shift  Model  Effectively  Places  the 
Compensator  Poles  Further  Into  the  Left  Half  Plane  Where 
Plant /Compensator  Interaction  Is  Weakened 
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As  discussed  above,  the  left-shift  approach  exploits  open-loop 
nondesrabilizing  uncertainties  and  thus  cannot  operate  through  a  priori  bounding. 

Thus  the  actual  level  of  robustificstion  achieved  from  the  robustified  optimal 
projection  equations  for  a  given  level  of  uncertainty  modeling  cannot  be  predicted  a 
priori,  i.e.,  in  advance  of  control  design.  Indeed,  this  situation  is  to  be  expected 
when  nondestabilizing  uncertainties  are  exploited  in  a  nonconservative  design  theory. 
Thus  a  suitable  robust  analysis  technique  is  required  for  nonconaervat ively 
determining  the  robust  if icat ion  of  the  closed-loop  system  with  respect  to  open-loop 
nondestabilizing  uncertainties. 

A  suitable  robustness  analysis  technique,  known  as  aajorant  Lyapunov 
analysis,  has  indeed  been  developed  ((A42]>.  Essentially,  this  technique  employs  a 
new  type  of  Lyapunov  function  for  assessing  robustness  due  to  weak  subsystem 
interaction.  The  underlying  machinery  consists  of  the  block-norm  matrix  which  is  a 
nonneaative  matrix  each  of  whose  elements  is  the  norm  of  a  block  of  a  suitably 
partitioned  matrix  (Figure  25).  A  matrix  which  bounds  the  block-norm  matrix  in  the 
sense  of  nonnegative  matrices,  i.e.,  element  by  element,  is  known  as  s  major ant. 
Majorants  were  introduced  in  (16]  and  were  applied  to  stability  analysis  of 
integration  algorithms  for  ODE's  in  (17). 

(Ostrowski,  1961;  Dahlquist,  1983) 
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Figure  25.  The  Matrix  Majorant  Is  s  Bound  for  the  Matrix  Block  Norm, 
i.e.,  the  Nonnegative  Matrix  Each  of  Uhose  Elements  Is  the  Norm  of  the 
Corresponding  Block  of  a  Given  Matrix 
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To  apply  aajoranra  to  dynamical  systems*  the  model  is  written  in  the  form 
shown  in  Figure  26.  The  matrix  A  is  block  diagonal  and  consists  of  subsystem 
dynamics.  The  subsystem  interactions  represented  by  the  partitioned  matrix  G  are 
assumed  to  ba  uncertain.  By  suitable  manipulation,  uncertainties  in  the  diagonal 
blocks  of  A  can  also  be  captured  by  G.  By  assuming  that  the  spectral  norm  (largest 
singular  value)  of  the  blocks  of  G  satisfy  given  bounds,  the  covariance  block-norm 
inequality  is  obtained  (Figure  27).  This  inequality  is  interpreted  in  the  sense  of 
nonnegative  matrices,  i.e.,  element -by-element ,  and  *  denotes  the  Hadamard  (element- 
by-element)  product. 
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figure  27.  The  Block -Norm  Matrix  of  the  State  Covariance  Satisfies  a 
Lyapunov-Type  Inequality  Involving  Nonnegative  Matrices 
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To  achieve  robustness,  the  covariance  block-nors  inequality  ia  replaced  by 
the  sajorant  Lyapunov  equation  (Figure  28).  The  solution  of  the  sajorant  Lyapunov 
equation  provides  a  bound  (sajorant)  for  the  block  nors  of  the  covariance  thereby 
guaranteeing  both  robust  stability  and  perforsance. 

MAJORANT  LYAPUNOV  EQUATION 

/?*q  =  s8*qst+t> 

?(Gij)  2  Sij 

Q<<Q 

ft 

■  Robust  Stability 

■  Robust  Performance 

Figure  28.  The  Corresponding  Nonnegative  Matrix  Equation  Yields  a  Majorant 
for  the  State  Covariance  and  Hence  Robust  Stability  and  Perforsance 

It  ia  interesting  to  note  that  nuserical  solution  of  the  sajorant  Lyapunov 
equation  requires  no  new  techniques.  Utilizing  properties  of  M  satrices,  the 
solution  can  be  obtained  sonotonically  by  scans  of  a  straightforward  iterative 
technique  (Figure  29). 

/A. 

MLE  has  a  unique  solution  ill  |(0|<,  K=0,  1,  ....  =*|  where: 

A 

Qo  *  o 

Q’k+i  =  '  (*/  Qk  *  Qdi7  * 

^  ^’Inn) 

converges.  II  so,  then: 

/\  /\ 

Q  =  llm 

K-cc 

r  „ 

J-J0<2X  (U  Pk)(cW)kk 

K=t 

(0  =  A  k  p«ak  * 

Figure  29.  By  Exploiting  the  Properties  of  M-Mstrices, 
the  Majorant  Lyapunov  Equation  Can  Be  Solved  Monotonically  by  Means  of  a 
SJsple  Iterative  Technique 
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An  illuatrative  application  of  the  mejorant  Lyapunov  equation  involvea 
lightly  damped  aubayatema  (Figure  30).  Aa  ahown  in  (AA2)  (and  expected  intuitively), 
rohuatneaa  with  reapect  to  uncertain  aubayatem  interaction  ia  proportional  to  the 
frequency  aeparation  between  the  aubayateaa.  The  ability  to  capture  thia 
robuatif ication  aechaniaa  ia  a  unique  feature  of  the  najorant  Lyapunov  function  not 
available  from  quadratic  (i.e.,  acalar)  Lyapunov  functiona  or  vector  Lyapunov 
functiona  ((18,19]). 


Majorant  Lyapunov  Equation  Bound ~  v  ,  (2u)2  +  2)2 


Figure  30.  Robuatneaa  Bounda  lor  Uncertain  Coupling  in  Modal  Syateme 
Are  Proportional  to  the  Frequency  Separation  Between  Subayatema 


The  next  etep  in  the  majorant  development  involvea  a  hierarchy  of  finer  and 
finer  robuatneaa  bounda  which  account  for  higher  order  aubayateai  interactiona.  e.g., 
the  interaction  between  the  ith  and  jth  aubayatema  via  the  kth  aubayateai.  The  aecond 
member  of  the  hierarchy  (Figure  31)  providea  robuatneaa  guaranteea  with  reapect  to 
frequency  uncertaint iea.  The  intereating  aapect  of  thia  robuatneaa  teat  ia  the  fact 
that  the  performance  bound  ia  characterized  preciaely  by  a  Stratonovich  model.  Hence 
the  Stratonovich  model  can  be  viewed  an  an  approximation  to  a  robuatneaa  bound,  while 
exploiting  the  Stratonovich/majorant  relationahip  leada  to  a  natural 
ayntheaia/analyaia  acheme  (Figure  32)  which  nonconeervatively  exploita  open-loop 
nondeatabilizing  uncertaintiea. 


I 


I 


289 


SYNTHESIS 


UTILIZE  STRATONOVICH  MODEL 
TO  EXPLOIT  NONDESTABILIZING 
OPEN-LOOP  UNCERTAINTIES 


UTILIZE  MAJORANT  LYAPUNOV 
EQUATION  TO  CHECK  ROBUSTNESS  WITH 
RESPECT  TO  CLOSED-LOOP  NONDESTABILIZING 
SUBSYSTEM  INTERACTION 


ANALYSIS 


Stratonovich  synthesis  =  approximation  to  majorant  analysis 

Figure  31.  The  Stratonovich  Synthesis  Model  Provides  a  First  Approximation  to  the 

Majorant  Analysis  Bounds 


Second  member  ot  the  hierarchy: 

ll  *  Q  *  UlQ)  =  }/<Q>  *  <Q>{jt  *  V> 


where: 


r  /n 

J  -  tr[QR]  <  2 X  (tr  PK)&<Q»KK 
K=1 

0  =  AQ  +  qat  +  ;/[Q]  +  V 
o  =  AtP  ♦  PA  +  f/t[P]  +  R 

<Q>  =  off-diagonal  part  of  Q 
//[.]  =  Stratonovich  model  operator 


■  Tighter  bound— incorporates  more  information  on  A  and  G 

■  Predicts  stability  when  (A  +  A^)  stable,  G  =  -G^ 

■  “Nominal”  performance,  tr  [QRJ,  given  by  Stratonovich  model 

Figure  32.  The  Refined  Hajorant  Bound  Incorporates  a  Stratonovich  Covariance  Model 


290 


5.  Numerical  Algorithms  and  Example* 

Practical  design  of  controllers  is  only  possible  when  efficient,  reliable 
algorithas  are  available.  Indeed,  the  optimal  projection  equations  are  readily 
solvable  and  have  been  applied  to  a  wide  variety  of  examples.  Numerical  results 
appear  in  [A3-A6,A8.A11.A12,A14-A16. A1B, A19. A21-A24, A26-A28, A30-A33, A39.A42. A4A.AA6] . 
Two  distinctly  different  algorithms  have  been  developed  thus  far,  namely,  an 
iterative  method  and  a  homotopy  algorithm. 

The  iterative  method,  developed  in  [A14.A16.A44]  and  further  studied  in 
(20,211,  is  outlined  in  figure  33.  The  nice  feature  of  this  approach  is  that  only 
a  standard  LQG  software  package  is  required  for  its  implementation.  The  basic 
motivation  for  the  method  is  the  observation  that  the  main  source  of  coupling  is 
via  the  terms  involving  r^.  The  coupling  is  absent,  of  course,  when  r  is  the 
identity,  i.e.,  LQG.  Note  also  that  the  terms  involving  are  small  when  and 
are  large,  i.e.,  when  control  cost  is  high  and  the  measurement  noise  is 
significant.  This  case,  which  yields  low-authority  controllers,  is  approximately 
characterised  by  decoupled  control-design  and  controller-reduction  operations. 

Thus  it  is  not  surprising  that  LQG  reduction  techniques  are  most  successful  when 
controller  authority  is  low. 

Since  the  r^  terms  occasion  the  greatest  difficulty,  it  appears 
advantageous  to  bring  then  into  play  gradually.  This  can  be  accomplished  by  fixing 
r  sfter  each  iteration  to  yield  updated  values  of  Q.  P,  Q  and  P.  Furthermore,  r  is 
introduced  gradually  by  sMsna  of  a  to  reduce  its  rank. 

The  crucial  step  of  the  algorithm  concerns  the  construction  of  the 
projection  r  from  the  pseudogramians  Q  and  P.  Specifically,  r  can  be  characterized 
(see  (A22] )  as  the  sum  of  eigenproject i ons  of  QP,  where  each  choice  of 
eigenprojections  may  correspond  to  a  local  extremal.  However,  the  necessary 
conditions  do  not  specify  which  eigenprojections  are  to  be  selected  for  obtaining  a 
particular  local  solution.  Nevertheless,  there  do  exist  useful  methods  for 
constructing  T.  For  example,  component-cost  decomposition  methods  ((22))  when 
applied  within  the  optimal  projection  framework  often  permit  efficient  identification 
of  the  global  optimum. 

Although  the  iterative  method  is  convenient  to  use  because  it  utilises 

readily  available  software,  it  is  suboptimsl  in  the  sense  that  it  does  not  fully 

exploit  the  structure  of  the  equations.  Specifically,  while  the  iterative  method 

addreeses  a  system  of  four  nxn  matrix  equations,  careful  analysis  reveals  that 

because  of  the  rank  deficiency  of  the  projection  the  problem  con  be  recast  as  four 

n  xn  equations.  Hence,  when  n  is  much  smaller  than  n,  which  is  clearly  the  most 
c  c 
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desirable  case  for  practical  implementat ion.  there  exists  considerable  opportunity 
for  increased  computational  efficiency.  Furthermore,  and  most  satisfying,  the 
computational  complexity  decreases  with  n£  as  is  intuitively  expected  below  that 
required  by  LOG  design.  Hence  the  optimal  projection  approach  has  computational 
complexity  less  than  LQG  reduction  methods  for  which  LQG  is  but  the  first  step. 

S.  Richter  ([23,A46])  has  developed  a  homotopy  algorithm  which  fully 
exploits  this  crucial  structure.  Numerical  experiments  thus  far  have  shown  that 
considerable  computational  savings  can  be  achieved  over  the  iterative  method. 
Furthermore,  by  applying  topological  degree  theory  to  investigare  the  branches  and 
character  of  the  local  extremals,  it  can  be  shown  that  the  maximum  number  of  possible 
extremals  is 

(min(n,m,X) 

"c 

if  nc  <_  min(n.m.X)  or  1  otherwise.  Hence  in  most  practical  cases  the  equations 
support  a  relatively  small  number  of  solutions. 

Both  the  iterative  method  and  the  homotopy  algorithm  have  been  applied  to  a 
design  problem  involving  an  8th-order  flexible  structure  originally  due  to  D.  Enna 
and  considered  in  1 1] .  Specifically,  a  variety  of  LQG  reduction  methods  are  compared 
in  [1]  for  a  range  of  controller  authorities.  These  methods  include: 

1.  Enns:  This  method  is  a  frequency-weighted,  balanced  realisation  technique 
applicable  to  either  model  or  controller  reduction. 

2.  Glover:  This  method  utilises  the  theory  of  Hankel  norm  optimal 
approximation  for  controller  reduction. 

3.  Davis  and  Shelton:  This  is  a  modification  of  compensator  reduction  via 
balancing  which  addresses  the  case  of  unstable  controllers. 

4.  Tousuff  and  Skelton:  This  is  a  further  modification  of  balancing  for 
handling  stable  or  unstable  controllers. 

5.  Liu  and  Anderson:  In  place  of  using  a  balanced  approximation  of  the 
compensator  transfer  function  directly,  this  method  approximates  the 
component  parts  of  s  fractional  representation  of  the  compensator. 
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All  of  the  above  methods  proceed  by  first  obtaining  the  full-order  LQG 
compensator  design  for  a  high-order  state-space  model  and  then  reducing  the  dimension 
of  the  resulting  LQG  compensator. 

Figure  34  summarizes  the  results  reported  in  [1]  for  the  above  LQG 
reduction  methods  along  with  results  obtained  using  the  iterative  method  for  solving 
the  optimal  projection  equations.  Here  q^  is  a  scale  factor  for  the  plant 
disturbance  noise  affect ing  cont roller  authority.  Clearly,  LQG  reduction  methods 
experience  increasing  difficulty  as  authority  increases,  i.e.,  as  the  terms  become 
increasingly  more  important  in  coupling  the  control  and  reduction  operations.  For 
the  low  authority  cases,  the  optimal  projection  calculations,  which  were  performed  on 
a  Harris  H800  minicomputer,  appeared  to  incur  roughly  the  same  computational  burden 
as  the  LQG  reduction  methods.  Although  the  optimal  projection  computational  burden 
increases  with  authority,  comparison  with  the  LQG  reduction  methods  is  not  meaningful 
because  of  the  difficulty  experienced  by  these  methods  in  achieving  closed-loop 
stability.  See  (A44]  for  further  details  and  for  comparisons  involving  transient 
response. 


The  homotopy  algorithm  was  also  applied  to  the  example  considered  in  [ 1 ] . 
One  of  the  main  goals  of  the  development  effort  was  to  extend  the  range  of 
disturbance  intensity  or,  equivalently,  observer  bandwidth,  out  beyond  =  2000.  To 
this  end,  second-order  (n^  =  2)  controllers  were  obtained  with  relatively  little 
computation  for  q^  =  10,000,  100,000  and  1,000,000.  In  addition,  the  performance  of 
each  reduced-order  controller  was  within  25X  of  LQG.  These  cases  can  surely  be 
expected  to  present  a  nontrivial  challenge  to  both  the  LQG  reduction  methods  and  the 
iterative  optimal  projection  method. 

Numerical  solution  of  the  robustified  optimal  projection  equations  has  been 
carried  out  for  several  examples.  For  illustrative  purposes  a  2x2  example  was 
considered  in  [A26 )  end  the  results  illustrated  in  Figure  35  indicate  performance/ 
robustness  tradeoffs  possible.  The  variable  left-shift  technique  was  applied  in 
[A19]  to  the  NASA  SC0LE  problem  with  frequency  uncertainties.  The  robustness  of  LQG 
and  two  robustified  designs  is  shown  in  Figure  36.  The  plots  illustrate  the 
degradation  in  performance  due  to  simultaneous  perturbation  of  all  modal  frequencies. 
Note  that  LQG  is  rendered  unstable  by  +5X  frequency  perturbation  while  a  high- 
authority  robustified  design  improves  this  region  to  +8X.  The  low-authority  design 
increases  this  region  significantly  while  sacrificing  6X  nominal  performance. 


Figure  35.  The  Robustified  Optinal  Projection  Equations  Provide 
Robustness/ Performance  Tradeoffs  for  a  Highly  Sensitive  Nooinal  LQG  Design 


RMS  LOS  ERROR  DEGRADATION  (X) 


MODAL  FREQUENCY  PERIURBATIOH  (X) 


Figure  36.  The  Stratonovich  Model  Robustifies  the 
LQG  Design  for  the  NASA  SCOLE  Model  with 
Uncertain  Modal  Frequencies 
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6.  Additional  Extensions 


The  robuetified  optical  projection  design  machinery  has  been  further 
extended  to  encompass  a  larger  number  of  design  cases  arising  in  practical 
application.  Here  we  merely  list  the  extensions: 

1.  Discrete-time  and  sampled-dara  controllers  ( (A2e.A30.A3A.A35) ) . 

2.  Decentralized  controllers  ( [A39] ) . 

3.  Nonstrictly  proper  controllers  ([A37]). 

A.  Distributed  parameter  systems  ( [A25] ) . 


7 .  Concluding  Remarks 

The  machinery  provided  by  OPUS  for  designing  active  controllers  for 
flexible  structures  has  been  reviewed.  The  basic  machinery  is  a  system  of  coupled 
Riccati  and  Lyapunov  equations  which  directly  generalize  the  classical  LOG  result  to 
include  both  a  constraint  on  controller  order  and  a  model  of  parameter  uncertainty. 
The  overall  approach  thus  encompasses  all  major  design  tradeoffs  arising  in 
vibration-suppression  applications.  Substantial  numerical  experience  has  been  gained 
through  an  iterative  method  requiring  only  an  LQC  software  package  and.  more 
recently,  by  means  of  a  highly  efficient  homotopy  algorithm  developed  by  S.  Richter. 
The  overall  approach  opena  the  door  for  effective  design  of  impl ementable  controllers 
for  large  precision  space  structures. 
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Matrix  Equation  for  Robust  Stability  and 
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Abstract — A  new  robust  stability  and  performance  analysis  technique 
is  developed.  The  approach  involves  replacing  the  state  covariance  by  its 
block-norm  matrix,  i.e.,  the  nonnegaiive  matrix  whose  elements  are  the 
norms  of  subblocks  of  the  covariance  matrix  partitioned  according  to 
subsystem  dynamics.  A  bound  (i.e.,  majorant)  for  tbe  block-norm  matrix 
is  given  by  tbe  majorant  Lyapunov  equation,  a  Lyapunov-type  nonnega- 
live  matrix  equation.  Existence,  uniqueness,  and  computational  traclabil- 
ily  of  solutions  to  the  majorant  Lyapunov  equation  are  shown  to  be 
completely  characterized  in  terms  of  M  matrices.  Two  examples  are 
considered.  For  a  damped  simple  harmonic  oscillator  with  uncertain  but 
constant  natural  frequency,  the  majorant  Lyapunov  equation  predicts 
unconditional  stability.  And,  for  a  pair  of  nominally  uncoupled  oscilla¬ 
tors  with  uncertain  coupling,  the  majorant  Lyapunov  equation  shows  that 
tbe  range  of  nondestabilizing  couplings  is  proportional  to  the  frequency 
separation  between  the  oscillators,  a  result  not  predictable  from  quadratic 
or  vector  Lyapunov  functions. 


I.  Introduction 

THE  importance  of  robustness  in  control-system  analysis  and 
design  cannot  be  overemphasized.  The  past  ten  years' 
literature  reflects  considerable  frequency-domain  development 
{ 1  ]-[  11].  while  recent  publications  indicate  increasing  time- 
domain  activity  [  1 2]— J 1 9] .  Wide  variations  in  underlying  assump¬ 
tions.  mathematical  settings,  and  problem  data  render  it  difficult, 
if  not  impossible,  to  clearly  delineate  the  relative  effectiveness  of 
different  methods.  Our  own  philosophical  outlook  has  thus  been 
guided  by  two  general  criteria: 

1)  effectiveness  for  simple  examples; 

2)  efficiency  when  applied  to  large  scale  problems. 

The  first  criterion  involves  applying  robustness  techniques  to 
simple,  perhaps  trivially  obvious,  examples  to  serve  as  "acid 
tests."  A  given  method's  effectiveness  on  a  collection  of  such 
examples  can  possibly  reveal  inherent  shortcomings.  As  an 
illustration  of  this  criterion,  consider  a  damped  harmonic  oscilla¬ 
tor  with  constant  but  uncertain  natural  frequency.  Using  the 
notation  of  [6],  stability  is  guaranteed  so  long  as 

<W \R(ju)(l  +  G(jw)K(jw)) -  'G(ju)L -  *(/'«)]  <  1 ,  lzO 

(1.1) 

where,  for  v  >  0, 

G(j)  =  (s2  +  2w  +  <j;)-' 
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and  uncertainty  in  the  nominal  natural  frequency  is  modeled  by 
A(s)  =  L-‘(s)6(s)R(s)  =  6uZ, 

L(s)=  1/a,  6(s)  =  6/a,  R(s)  =  w2,  tf(s)  =  0, 

6  €  [-min  (I,  a),  a],  a>0. 

Note  that 

<7mi»[0(./«))sl,  wzO 

as  required  in  [6].  The  perturbation  A(s)  (modeled  as  a  feedback 
gain)  effectively  replaces  u-  in  G(s)  by  (1  +  5)<u 2.  Hence,  for  a 
given  a  >  0  this  uncertainty  model  permits  perturbed  natural 
frequencies  in  the  range  [0.  (1  +  a)1  :wn].  Evaluating  ( 1 . 1)  yields 
the  upper  bound 

a<[(uj-u;:):  +  4»';tt,;:]1  :/u)*,  uZO  (1.2) 

or.  equivalently, 

c*  <  2  ft  1  -  f2)1  2  (1.3) 

where  f  s  v/w„.  The  conservatism  of  (1.3)  is  obviously  most 
pronounced  when  the  damping  ratio  f  is  small.  In  all  cases, 
however,  the  conservatism  is  infinite. 

The  second  criterion  is  obviously  subjective  and  depends  upon  a 
variety  of  factors  such  as  problem  structure,  designer  experience, 
and  computational  resources.  This  criterion  is.  in  our  opinion, 
most  important  since  the  need  for  robustness  techniques  becomes 
increasingly  critical  as  system  complexity  grows.  Indeed,  the 
ultimate  lest  of  a  given  approach  is  to  scale  it  up  to  larger  and 
larger  problems  to  reveal  inherent  limitations.  Obviously  ,  such 
tests  are  not  only  difficult,  but  may  entail  a  significant  commit¬ 
ment  of  human  and  financial  resources.  Nevertheless,  crude 
predictions  are  sometimes  available,  and  a  case  in  point  is  the 
"curse  of  dimensionality"  encountered  in  the  approach  of  [9], 
Another  example  involves  computational  difficulties  in  obtaining 
bounds  for  the  ^-function  with  more  than  three  blocks  [10], 

The  contribution  of  the  present  paper  is  a  new  robustness 
analysis  method  developed  specifically  for  large  scale  systems. 
The  basic  idea,  motivated  by  the  work  of  Siljak  [30]  on  connective 
stability,  is  as  follows.  The  system  is  assumed  to  be  in  the  form  of 
a  collection  of  subsystems  with  uncertain  local  dynamics  and 
uncertain  interactions. 1  Parameter  uncertainties  are  modeled  as 
either  structured  or  unstructured  constant  variations  contained  in 
prescribed  sets.  The  state  covariance,  partitioned  conformably 
with  the  subsystem  dynamics,  is  replaced  by  its  block-norm 
matrix,  i.e.,  the  nonnegative  matrix  each  of  whose  elements  is  the 
norm  of  the  corresponding  subblock  of  the  original  matrix.  This 
nonnegative  matrix  satisfies  a  novel  inequality  designated  the 

1  Uncertainties  in  a  single  subsystem  can  also  be  regarded  as  interaction 
uncertainties.  To  see  this,  write  X  -  (A  ■ f  G)x  twice  so  that  the  uncertainty 
G  is  represented  by  |°  £]. 
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covariance  block-norm  inequality.  The  existence  of  a  solution 
to  the  majorant  Lyapunov  equation,  i.e  ,  the  covariance  block- 
norm  inequality  interpreted  as  an  equation,  yields  an  element-by- 
element  bound  (i.e.,  majorant)  for  the  covariance  block-norm, 
hence,  assuring  robust  stability  and  performance.  The  relevance 
of  this  technique  to  large  scale  systems  stems  from  the  fact  that 
replacing  each  subblock  of  the  covariance  by  its  norm  can 
significantly  reduce  the  dimension  of  the  problem.  Indeed,  the 
dimension  of  the  majorant  Lyapunov  equation  is  equal  to  the 
number  of  subsystems  which  may  be  significantly  less  than  the 
dimension  of  the  original  system. 

To  illustrate  the  above  ideas  in  more  detail,  consider  the 
covariance  equation 

0  =  {A  +  G)Q+Q(A+G)T+V  (1.4) 

where  A  denotes  the  nominal  dynamics,  G  denotes  uncertainty  in 
A ,  V  is  the  disturbance  intensity,  and  Q  is  the  state  covariance. 
Assuming  that  A  is  block  diagonal  with  r  diagonal  blocks  leads  to 
the  covariance  block-norm  inequality  (see  Proposition  4.2) 

a  •  q,ssgci+ciSir+'v>.  (i.s) 

In  (15),  <1.  Q,.  g.  and  V  are  r  x  r  nonnegative  matrices,  i.e., 
each  element  is  a  nonnegative  number.  The  matrices  Q,  and  V  are 
formed  by  taking  the  Frobenius  norm  of  each  subblock  of  Q  and 
V,  while  each  component  of  g  is  a  given  constant  which  bounds 
the  spectral  norm  (largest  singular  value)  of  the  corresponding 
subblock  of  the  uncertain  perturbation  C.  Hence,  S  is  a  majorant 
for  G  in  the  sense  of  [21]-[23J.  Each  element  of  the  matrix  3  is 
bounded  above  by  the  smallest  singular  value  of  the  Kronecker 
sum  [24]-[26]  of  pairs  of  diagonal  blocks  of  A.  The  operation 
"•*’  is  the  Hadamard  product  (27],  [28],  and  the  ordering 
••  s  s’’  denotes  element-by-element  comparison,  i.e.,  the  order¬ 
ing  induced  by  the  cone  of  nonnegative  matrices  [29],  [30]. 

The  majorant  Lyapunov  equation  is  obtained  by  replacing  the 
inequality  (1.5)  by  the  r  x  r  nonnegative  matrix  equation 

a .  <3.=  g<3.+<3.S7'+v.  <i.6> 

A  key  result  (Corollary  5.1)  slates  that 

CUs<5.  (17) 

for  all  stable  A  +  G.  Consequently  (see  Theorem  5  1),  the 
existence  of  a  unique  solution  to  (1 .6)  leads  directly  to  a  guarantee 
of  robust  stability  over  the  range  specified  by  g  and  to  a 
performance  bound  involving  <5..  Moreover,  solutions  of  (1.6) 
exist  if  and  only  if  the  r •  x  r 2  matrix 

A  a  diag  (vec  G)~g  ®  g  (1-8) 

is  an  .Vf  matrix  [29],  [30]. 

Even  when  the  number  of  subsystems  is  large,  the  majorant 
Lyapunov  equation  is  generally  computationally  tractable.  Specif¬ 
ically.  although  A  is  an  r2  x  r*  matrix,  no  computations 
whatsoever  need  to  be  carried  out  with  matrices  of  this 
dimension.  Rather,  it  suffices  to  solve  only  the  majorant 
Lyapunov  equation  (1.6).  In  this  regard  we  show  that  §,  is  given 
by 

$=lim$,  (1.9) 

i  —  m 

where  if  G  has  only  off-diagonal  nonzero  blocks  the  sequence 
is  generated  by 

Q  •  £„l  =  g£,  +  $,9,'+v.  $o*=0  (1.10) 

and  is  monotonically  increasing.  Furthermore,  the  convergence  of 
this  sequence  is  equivalent  to  A  being  an  M  matrix  so  that  it  is  not 
even  necessary  to  form  A-  Note  that  (1.6)  does  not  require  the 
development  of  new  solution  techniques.  Indeed,  since  (1 . 10)  is  a 


straightforward  iteration.  (1.6)  is  even  easier  to  solve  than  the 
original  Lyapunov  equation  (14). 

To  illustrate  these  results  we  consider  two  examples.  The  first 
example  is  the  damped  oscillator  already  considered  in  this 
section.  With  little  effort  the  majorant  Lyapunov  equation  yields 
the  (obvious)  result  that  the  oscillator  is  stable  for  all  constant 
natural  frequencies.  The  second  example  involves  a  pair  of 
oscillators  with  known  parameters  but  with  uncertain  coupling. 
The  majorant  Lyapunov  equation  yields  bounds  over  which 
stability  is  guaranteed,  and  these  bounds  are  compared  to  the 
actual  stability  region  as  a  function  of  frequency  separation.  The 
main  result  shows  that  the  robustness  to  uncertain  coupling  is 
proportional  to  the  frequency  separation.  This  weak  subsystem 
interaction  robustification  mechanism  is  the  principal  contribution 
of  the  majorant  theory.  This  example  has  immediate  application  to 
the  problem  of  vibration  control  in  flexible  structures  For  this 
class  of  problems  the  open-loop  dynamics  can  be  viewed  as  a 
collection  of  uncoupled  oscillators  which  become  coupled  via 
feedback  and  structural  uncertainties 
The  majorant  bound  developed  in  the  present  paper  is  quite 
different  from  the  widely  used  quadratic  Lyapunov  function  (see, 
e  g  ,  [121-[20]).  As  can  readily  be  shown  using  the  methods  of 
[12],  [17]-[20],  the  quadratic  Lyapunov  function  yields  robust 
stability  and  performance  by  replacing  (1.4)  by 

0  =  A$+OAr  +  0(<5)-i-  V  (1.11) 

where  fl(  • )  satisfies 

G0+0Grsn(<2)  (112) 

for  all  variations  G.  It  can  then  be  shown  that 

Q-S.Q  (1-13) 

where  now,  in  contrast  to  (1.7).  the  ordering  in  (1.13)  is  defined 
with  respect  to  the  cone  of  nonnegative-definite  matrices. 
Indeed,  the  majorant  bound  may  be  more  closely  related  to  vector 
Lyapunov  functions  [30],  [31]  and  the  Lyapunov  matrix  function 
[32],  [33].  It  does  not  appear  possible,  however,  to  use  these 
techniques  to  obtain  the  majorant  results  on  robustness  due  to 
subsystem  frequency  separation. 

The  reader  will  observe  that  this  paper  exploits  a  wide  variety 
of  techniques  including  nonnegative  matrices,  block  norms, 
matrix  majorants,  the  Hadamard  product,  the  Kronecker  sum.  and 
M  matrices.  Each  of  these  techniques,  except  majorants.  has. 
however,  been  previously  applied  to  control  problems  in  numer¬ 
ous  instances.  In  the  special  case  of  scalar  subblocks,  the  block- 
norm  matrix  has,  moreover,  been  utilized  by  Yedavalli  [13]-115] 
and  others  for  robustness  analysis  and  design.  In  this  case  the 
block  norm  is  known  as  the  matrix  modulus.  The  variety  of 
algebraic  structures  employed  in  the  present  paper  should  not  be 
surprising  since  the  quest  for  increasingly  refined  robustness 
techniques  can  be  expected  to  invoke  correspondingly  refined 
uncertainty  bounds  Related  techniques  are  employed  in  [11]. 
Furthermore,  nonnegative  matrix  equations  involving  M  matrices 
arise  naturally  in  a  variety  of  settings  (see,  e  g.,  [38],  [39]) 

The  contents  of  the  paper  are  as  follows.  Section  II  presents 
notation,  definitions,  and  lemmas  for  use  throughout  the  paper  In 
Section  III  robust  stability  and  performance  are  defined  for  the 
homogeneous  and  nonhomogeneous  systems.  Detailed  system 
structure  and  uncertainty  characterization  are  given  in  Section  IV 
and  the  covariance  block-norm  inequality  is  derived.  Section  V 
analyzes  the  majorant  Lyapunov  equation  to  obtain  a  majorant  for 
the  steady-state  covariance.  The  main  result.  Theorem  5.1, 
guarantees  robust  stability  and  provides  a  performance  bound. 
Finally,  the  examples  appear  in  Section  VI. 

II.  Preliminaries 

The  following  notation  will  be  used  throughout.  All  matrices 
are  assumed  to  have  real  entries. 
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i 

expected  value 

St,  Ii1”"',  Si’’ 

real  numbers,  pxq  real  matrices. 
SP" 

Ip •  0p*,f  Op  . 

pxp  identity  matrix,  pxq  zero  ma¬ 
trix,  0pKp 

•.  « 

Kronecker  sum,  Kronecker  product 
[24H27J 

* 

Hadamard  product  [27],  [28] 

col,  (Z ) 

tth  column  of  matrix  Z 

coli  (Z) 

vec  (Z) 

€  I i”,  Z  £ 

col,  (Z)  _ 

Zu.it 

(/,  j)  element  of  matrix  Z 

ZT 

transpose  of  vector  or  matrix  Z 

ZT 

(Zr)-‘  or  (Z-‘)r 

tr  Z 

trace  of  matrix  Z 

diag  (Z,.  •  •  •,  Zp) 

diagonal  matrix  with  listed  diagonal 
elements 

block-diag  (Zt,  •  •  •, 

Zp)  block-diagonal  matrix  with  listed  diag¬ 

onal  blocks 

p(Z) 

spectral  radius  of  Z 

asymptotically  stable 

matrix  with  eigenvalues  in  open  left- 

matrix 

half  plane 

nonnegative-definite 

symmetric  matrix  with  nonnegative  ei¬ 

matrix 

genvalues  (Z  &  0) 

positive-definite 

symmetric  matrix  with  positive  eigen¬ 

matrix 

values  (Z  >  0) 

Z,  >  Z; 

Z,  -  Z;  a  0,  Z|,  Z;  symmetric 

Z,  ^  Z; 

Z,  -  Z2  >  0,  Zlt  Z:  symmetric 

non negative  matrix 

matrix  with  nonnegative  elements 
(Z22  0)  [29],  [30] 

positive  matrix 

matrix  with  positive  elements  (Z  ►  0) 

Z,  2  2  Z: 

Z,  -  Zj  2  2  0 

Z,  ►  Z; 

Z,  -  Z:  ►  0 

zm 

Hadamard  inverse.  (ZH,)«., ,* 

[Z„„]  *,  Z  ►  0 

block-norm  matrix 

nonnegative  matrix  each  of  whose  ele¬ 
ments  is  the  norm  of  a  corresponding 
subblock  of  a  given  partitioned  matrix 

majorant 

nonnegative  matrix  each  of  whose  ele¬ 
ments  bounds  the  corresponding  ele¬ 
ment  of  a  block-norm  matrix 

II ZP: 

Euclidean  norm  of  vector  Z 

o,(Z) 

singular  value  of  matrix  Z 

tTminCZ),  0,na\(Z) 

smallest  and  largest  singular  values  of 
matrix  Z 

l 

N 

largest  eigenvalue  of  symmetric  matrix 

7 

II Z  (1 5 

'W(Z)  (spectral  norm  induced  by 

II  *11  2) 

r  p*  1 1 2 

!IZ|!r 

("ZZ')'=-[2  Z;,„J 

(Frobenius  norm  (34J). 

In  subsequent  sections  we  shall  exploit  the  fact  that  the  norms 
II  'll;.  H'IIj.  ar>d  II ’Up  coincide  for  vectors.  Hence,  if  Z  £ 
then  by  interpreting  H”  =  Si'”"  it  follows  that 


izi2-izg,«|z|r.  (2.i) 

Furthermore,  if  Z  €  W'q,  then 

II Z  || ,  s  ||  Z  ||  F  =  ||  vec  Z  ||  F  =  ||  vec  Z  « j  =  1  vec  Z  || ,.  (2.2) 


Lemma  2.1:  If  Z  £  Str'Q  and  2  £  Hq * '  then 

omi„ (Z) II Z II F s  I! ZZ I, <  II Z || , II Z li F .  (2.3,  2.4) 

If.  furthermore,  p  =  q  =  rZ>0,  and  2  is  symmetric,  then 
tr  Z2  £  (tr  Z)\mtl(2)S(tT  Z)\\2\\,.  (2.5) 

Proof:  Inequality  (2.4)  can  be  found  in  [35,  p.  263).  To 
prove  (2.3).  note  that  when  Z  is  singular  the  result  is  immediate. 
Otherwise,  if  p  =  q  replace  Z  and  2  in  (2.4)  by  Z~‘  and  Z2, 
respectively.  The  result  now  follows  from  (twfZ)]'1  = 
Om.rlZ’ ').  Up  *  q,  then  related  arguments  apply.  Finally,  (2.5) 
is  given  in  [36).  □ 

Recall  (30)  that  a  matrix  S  £  Ji'* '  is  an  N  matrix  if  Stlj,  S  0, 
i,j  =  1,  ■  •  • ,  r,  i *  j.  If.  in  addition,  all  principal  minors  of  S  are 
positive,  then  S  is  an  M  matrix. 

Lemma  2.2:  Suppose  S  £  Jf'*'  is  an  N  matrix.  Then  the 
following  are  equivalent: 

i)  S  is  an  M  matrix; 

ii)  det  S  *  0  and  S~‘  2:  a  0; 

iii)  for  each  y  €  B',  y  2  2  0,  there  exists  a  unique  x  €  Ji\  x 
2t  >  0.  such  that  Sx  -  y, 

iv)  there  exists  x  £  IT,  x  2  &  0.  such  that  Sx r  ►  0; 

v)  /,  *  S  ►  0  and  each  diagonal  matrix  D  >  I,  •  S  satisfies 
p[D-'(I,  *S  -  S)]  <  1. 

Proof:  The  equivalence  of  statements  i).  ii),  iv),  and  v) 
follows  from  [30,  p.  396)  The  implication  ii)  -  iii)  is  immediate, 
and  iii)  *»  iv)  follows  by  setting  y  -  [1  1  •  ■  •  l) T.  ZZ 

Lemma  2.3:  Suppose  S  £  Jr*'  is  an  M  matrix  and  let  5  € 
Jl'*'  be  an  N  matrix  such  that  $  >  &  S.  Then  $  is  an  M  matrix. 


Proof:  See  [30,  p.  400).  □ 

HI.  Robust  Stability  and  Performance  Bounds 
Consider  the  nth-order  homogeneous  system-' 

x(r)  =  (A(6)  +  G)x(r),  t  €  [0,  »),  (3.1) 

g  £  a  c  J r*\  (3.2) 

e  £  e  c  jr,  (3.3) 


where  A  .Q  —  It"'"  is  continuous,  A  -  A  (6)  denotes  the  known 
nominal  dynamics  for  6 _  £  0.  8  denotes  the  unstructured 
parametric  uncertainty  in  A .  G  denotes  the  structured  parametric 
uncertainty  in  A.  and  0  £  S  is  the  nominal  value  of  G.  We  first 
consider  the  stability  of  (3.1)  over  a  and  0. 

Definition  3.1:  If  A  (6)  +  G  is  asymptotically  stable  for  all  G 
€  B  and  8  £  0.  then  the  homogeneous  system  (3.1)  is  robustly 
stable  over  a  and  0. 

Now  consider  the  nth-order  nonhomogeneous  system 

xit)  =  (A(6)+G)x(t)+  w{t),  i  £  [0,  oo)  (3.4) 

where  C  £  a,  8  £  0,  and  w(  • )  is  white  noise  with  intensity  V  a 
0.  For  given  G  £  a  and  8  £  0,  the  steady -state  average 
quadratic  performance  is  defined  by 

J(G,  8 )  =  lim  sup  I[xr(/)/?x(r)]  (3.5) 

t  —  OB 

where  R  =  RT  a  0.  The  system  (3.4)  may,  for  example,  denote 
a  control  system  in  closed-loop  configuration.  There  is  no  need  in 
our  development,  however,  to  make  such  distinctions 

In  practice,  steady-state  performance  is  only  of  interest  when 
the  system  is  robustly  stable.  The  following  result  is  immediate. 

Proposition  3.1:  Suppose  the  system  (3.1)  is  robustly  stable 

:  Upon  first  reading  the  uncertainty  represented  by  (3.3)  can  be  ignored 
since  the  principal  contribution  concerns  the  treatment  of  (3.2). 


j 
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over  a  and  0.  Then  for  each  C  G  a  and  BE  0, 

J(G,  0)  =  tr  QR  (3.6) 

where  n  x  n  nonnegative-definite  Q  is  the  unique  solution  to 

0  =  (A(8)  +  G)Q  +  Q(A(8)  +  G)T+V.  (3.7) 

We  shall  only  be  concerned  with  the  case  in  which  a  and  0  are 
compact.  Since  Q  is  a  continuous  function  of  G  and  8,  we  can 
define  the  worst-case  average  steady-state  quadratic  performance 

k  max  J(G,  8).  (3.8) 

Get. *€8 

Since  it  is  difficult  to  determine  7**,  explicitly,  we  shall  seek 
upper  bounds. 

Definition  3.2 :  If  <  a.  then  a  is  a  performance  bound 
for  the  nonhomogeneous  system  (3.4)  over  a  and  8. 

IV.  System  Structure,  Uncertainty  Characterization,  and 
the  Covariance  Block-Norm  Inequality 

A  discussed  in  Section  I,  (3.1)  and  (3.4)  are  assumed  to  be  in 
the  form  of  a  large  scale  system  with  uncoupled  local  dynamics 
and  uncertain  interactions.  Hence,  with  the  subsystem  partitioning 

r 

n  =  '£n,  (4.1) 

f-1 

the  local  system  dynamics  A(B)  can  be  decomposed  into 
subsystem  dynamics  according  to 

A (0)  =  block-d iag  {A, (6)}  (4.2) 

I-  1,  ••  -.r 

where  >4,(0)  E  0  €  8.  For  convenience,  denote 

A  s  block-diag  {/4,}. 

1-1.  ,r 

Accordingly.  R  is  assumed  to  be  of  the  form 

R  =  block-diag  { R, }  (4.3) 

i*i.  -  .<■ 

where  R,  E  flni  R,  2:  0,  /  =  1,  ■  •  •,  r.  The  intensity  V  and 
steady-state  covariance  Q  satisfying  (3.7)  are  assumed  to  be 
conformably  partitioned,  i.e.. 


(4.4) 

(2=  Q,J  e 

(4.5) 

For  notational  simplicity  define 

K  k  V„,  Q,  2  Q„,  »  =  1,  • 

• .  r. 

(4.6) 

Taking  the  Frobenius  norm  of  each  subblock  of  V  and  Q  leads  to 
the  r  x  r  symmetric  nonnegative  matrices  V  and  Q,  defined  by 


v  =  {II  yj r) d  a  {II&Je};.,.,.  (4.7) 

Note  that 

ii  dii  e=  ii  oil  e.  mF-mF.  (4.8) 

A  few  observations  concerning  the  nominal  system,  i.e.,  with 
G  =  0  and  6  =  6,  are  worth  noting.  If  A  is  stable  then  so  is  A,,  i 
=  1,  •  ■  r.  and  there  exist  unique,  nonnegative-definite  Q,,  P, 
E  i  =  1,  r.  satisfying 

o  =  A,Q,  +  Q,AJ+Vi.  (4.9) 

O^AJPi  +  PtAj  +  Ri.  (4.10) 


Proposition  4.1:  Suppose  A  is  asymptotically  stable  Then  the 
nominal  performance  7 ^  is  given  by 

r  r 

J*™  k  7(0.  0)=£  tr0,*,  =  2  tr  P,V„  (4.11) 

i*l  i-1 

Proof:  First  note  that  with  G  =  0  and  0  =  6  the  diagonal 
blocks  of  Q  satisfying  (3.7)  coincide  with  @u  ■  ■  ■ ,  @r  Thus 

7(0,  6)='2trQ,R, 

l»  1 

r 

=  2)  (vec  0,)rvec  R, 

I  -  I 

r 

=  2  [(A,  9  A,)-'  vec  VA  T  vec  R, 

/«  I 

r 

=  X  (vec  K)  t{A  f  ©  A  T) ~ 1  vec  R, 

/« i 

t 

-  S  (vec  yAT  vec  P, 

I*  I 

=i>£u,.  = 

i*i 

The  matrices  G  E  D  are  also  conformably  partitioned  so  that 

G={Gu}';.lt  Gy  €  R"ix"y  (4.12) 

and  IS  is  characterized  by 

H{Ger':UG,)<v  1,7=1,  •••.r}  (4.13) 

where  yv  a  0,  i,  j  =  1,  r,  are  given  constants.  For 
convenience,  define  the  r  x  r  nonnegative  matrix 

9  =  M'j.r  (4-14) 

The  bound  8  >s  a  matrix  majorant  for  G  €  fi  in  the  sense  of 

(2 1  J— [23J . 

Remark  4.1:  §  is  compact  and  convex. 

Finally,  let  symmetric,  positive  Cl  G  Jlrxr  satisfy 

min  {<rm,„(Aj(B)  ®  /4,(0))},  i,j=l,  --,r.  (4.15) 


Proposition  4.2:  Let  G  E  §  and  0  G  0  be  such  that  A  (0)  + 
G  is  asymptotically  stable  and  let  n  x  n  Q  a  0  satisfy  (3.7). 
Then  Q,  defined  by  (4.7)  satisfies 


G  *  <Sd+d8r+'v 

(4.16) 

or,  equivalently, 

A  vec  Q.<  <  vec  V, 

(4.17) 

where 

A  k  [diag  (vec  G)]-8®8- 

(4-18) 

Proof:  Expanding  (3.7)  yields 

r 

-\Ai(8)Q,J  +  Qi/Aj{8)]=^  I GlkQkj  +  QlkGTjk)+  Vu, 

.  *- 1 


,7=  l,  •••,/•. 


(4.19) 
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Thus.  (5.4)  is  equivalent  to 

vec  4..  i  =  {diag  (v<*  <*)  -  (A  *  8)  •  V,  *  S)J ' 1 


Bounding  the  right-hand  side  of  (4.19)  from  above  using  (2  4) 
yields  for  all  G  £  © 

J  2  [G*Qv+<2»Gr]+K(, ||f 

r 

*.  i 


while  bounding  the  left-hand  side  of  (4.19)  from  below  using  (2.3) 
implies  for  all  6  6  0 

II  -  [A,(6)Q0+  QvAjmU- llvec  (A,{6)Q,j+  QijAj(6))\\F 
=  \\(AM  ®  AM)  vec  Q.jWr 
*oma(Aj(6)  *  AM)  ||vee  Qu||f 
=  am„  (A/8)  *  A,(6m0,y) 

Combining  the  above  inequalities  yields  (4. 16).  □ 

Remark  4.2:  Since  §  2i  0,  the  r 2  x  r 2  matrix  is  an  A' 

matrix  (30]. 

V.  The  Majorant  Lyapunov  Equation 
In  this  section  we  interpret  (4.16)  as  an  equality  rather  than  an 


inequality  and  consider  the  Lyapunov-type  nonnegative  matrix 
equation 

G  *  5.=  g3.+  $.gr+v 

(5.1) 

or,  equivalently, 

A  vec  $.  =  vec  V. 

(5.2) 

Note  that  since  G  and  V  are  symmetric  a  unique  solution  of  (5.1) 
is  necessarily  symmetric 

Proposition  5.1:  The  following  are  equivalent: 

i)  A  is  an  M  matrix; 

ii)  det  A  *  0  and  J)'1  2:  >  0; 

iii)  for  each  r  x  r  symmetric  V  >  >  0  there  exists  a  unique  r 
x  r  >  >  0  satisfying  (5.1); 

iv)  there  exist  r  x  r  symmetric  V  ►  0  and  r  x  r  symmetric 
>  >  0  satisfying  (5.1); 

v)  diag  (vec  G)  -  (/,  *  8)  ®  (I,  *  9)  ►  0  and  each  diagonal 
matrix  £>  >  >  diag  (vec  G)  -  (/,  *  g)  ®  Ur  *  9)  satisfies 

p(0-'(9«S-a  *  8)*  a  *S)])<1;  (5.3) 

vi)  for  each  r  x  r  symmetric  ^  S  0  and  r  x  r  symmetric  V 
i  a  0,  the  sequence  {£),,}“  ,  generated  by 

*  5.1+  I  -  (A  •  6)4/*  I  -  §.i*  lUr  •  8) 

=  (S-/r‘S)3..  +  <3.-(S-A*S)7'+,v.  /- o,  i,  (5.4) 

converges; 

vii)  for  each  r  x  r  symmetric  §,o  2  a  0  there  exists  r  x  r 
symmetric  V  ►  0  such  that  the  sequence  {§,/}"  ,  generated  by 
(5.4)  converges. 

Proof:  Statements  i)-v)  are  equivalent  to  i)-v)  of  Lemma 
7.2.  Clearly,  vi)  implies  iii),  and  vii)  implies  iv).  To  show  v) 
implies  vi)  and  vii)  note  that  Ij  *  (g  ffi  g)  =  (/,  *  g)  •  (Ir  *  S) 
and 


•  [8  ®  8  -  Ip  *  (8  •  8)1  vec  +  [diag  (vec  G)]  ~ 1  vec  V. 
Thus,  vi)  and  vii)  follow  from  v)  with  2)  =  diag  (vec  G)  —  (I,  * 

S)  ®  (I,  *  S).  □ 

Since  statements  i)-vii)  depend  only  upon  G  and  8  we  have  the 
following  definition  inspired  by  v)-vii). 

Definition  5.1:  (G,  g)  is  stable  if  &  is  an  M  matrix. 
Remark  5.1:  When  /,  *  g  =  0,  i.e.,  when  the  local  dynamics 
have  no  structured  uncertainty,  (5.4)  simplifies  to 

a  •  §.„1  =  S§.,  +  $.,ST+V,  /  =  0,  !,  •••,  (5.5) 


4/.i=Gw*  (S$.,  +  $,Sr+V),  1  =  0,  1 ,  -  -  - .  (5.5a) 

The  following  result  shows  that  for  zero  initial  condition,  the 
iterative  sequence  is  monotonic. 

Proposition  5.2:  Suppose  diag  (vec  G)  -  1,2  *  (g  ®  S)  ►  0. 
Then  the  sequence  generated  by  (5.4)  with  Q.0  =  0  and  V 

>  >  0  is  monotonically  increasing. 

Proof:  To  simplify  notation  we  consider  the  case  mentioned 
in  Remark  5.1.  Hence,  assume  G  ►  0.  Clearly,  if  (50  =  0,  then 
(5.5a)  implies  that  =  Gw/  *  V  &  a  0.  Hence,  Q.,  a  &  §.o- 
Defining  A  §.,■♦!  £  Q.,»i  -  5.,.  (5.5a)  yields 

A$,,t)=Gw  •  (SA$,  +  A§.,87'). 

Since  A§.,  s  2:  0,  the  result  follows  from  induction.  G 

Remark  5.2:  Proposition  5.2  is  a  particularly  useful  result  in 
applications  and  can  be  utilized  as  follows.  Setting  §.o  =  0,  the 
sequence  { §,,}  can  be  evaluated  by  a  simple  numerical  procedure. 
As  will  be  shown  in  Theorem  5. 1  below,  each  corresponds  to  a 
robust  performance  measure  a,.  For  practical  purposes  the 
increasing  sequence  {a,}  can  be  generated  until  either  conver¬ 
gence  is  attained  (in  which  case  a  =  lim,-„  a,  is  a  robust 
performance  bound)  or  a  maximum  permissible  performance  level 
is  exceeded.  In  the  latter  case  the  question  of  convergence  is 
irrelevant  since  the  closed-loop  system  is  known  to  either  be 
unstable  for  some  G  €  S  (i.e.,  a  =  o°)  or  exceed  acceptable 
performance  specifications,  thereby  necessitating  system  rede¬ 
sign. 

We  now  prove  a  comparison  result  for  solutions  of  (5.1). 

Lemma  5.1:  Assume  (G,  g)  is  stable,  let  3,  g  be  r  x  r 
nonnegative  matrices  where  3  is  symmetric,  and  assume  that 

Gs<3,  gssS-  (5-6) 

Then  (3,  §)  is  stable.  Furthermore,  let  r  x  r  symmetric  *V  satisfy 

5><SV,  (5.7) 

let  be  the  unique,  nonnegative  solution  to  (5. 1 ),  and  let  Q,  be  the 
unique  solution  to 

3  »  ^  =  §^+§,g7'+^.  (5.8) 


Then  if  Q,  a  £  0,  it  follows  that 

s$, 

Proof:  Since 

A  A  diag  (vec  3)  -  g  ®  g 
is  an  N  matrix,  A  is  an  M  matrix,  and 

&-&  =  diag  (vec  (3-G))  +  (g-g)  •  (g-g)a  aO 


(5.9) 


or,  equivalently. 


vec  (G  *  4L*  i)  =  (diag  (vec  G)]  vec  $./♦  |. 
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it  follows  from  Lemma  2.3  that  j\  is  an  M  matrix,  and  thus  (3,  §) 
is  stable.  Next  note  that  (5.1)  and  (5.8)  imply 

vec  (ft-4)  =  A_,(&-  A)  vec  Q.  +  A'1  vec  (V-*0). 

Since  A  aaO^-1  aaO  (see  Lemma  2.2), 

0,  and  4  ^  s  0,  it  follows  that  (5.9)  is  satisfied.  □ 

Corollary  5.1:  Suppose  (Q,  9)  is  stable  and  let  Si  be  the 
unique,  nonnegative  solution  to  (5.1).  Furthermore,  let  G  E  fi 
and  6  €  0  be  such  that  A  (6)  +  G  is  asymptotically  stable  and 
define  Q,  by  (4.7)  for  n  x  n  Q  a  0  satisfying  (3.7).  Then 

(5.10) 


On  the  other  hand,  for  n  £  [0,  1)  it  follows  that 

Q0ri=Q0ri-QU.  0  +  Q(m.  0-0(1.  0  +  Q0.  0 

*Q(».  O-OO.  0  +  00.  0 

which  implies,  for  arbitrary  x  £  ft", 

* TQ(ji)xzxTlQ<j*,  0-00.  01*+*r0(l.  0*. 

Thus,  by  continuity  of  0(^>  0  in 

lim  :r7(>0ri*a*7'<?(l,  0-T.  x  €  ft".  (5.17) 


Proof:  By  Proposition  4.2,  Q,  satisfies  the  covariance  block- 
norm  inequality  (4.16).  In  the  notation  of  Lemma  5.1  define 

3  =  a.  §  =  9.  *  Q-fSa+ftS7')  (5.ii) 

so  that  (5.6)  is  satisfied  and  (4.16)  implies  (5.7).  Note  that  with 
the  notation  (5.11),  equation  (5.8)  has  die  unique  solution  =  Q. 
>s  0.  Hence  (5.9)  implies  (5.10).  C 

Theorem  5.1:  Assume  A  is  asymptotically  stable,  0  is 
continuously  arewise  connected,  and  (Ct,  9)  is  stable.  Then  the 
homogeneous  system  (3.1)  is  robustly  stable  over  II  and  0,  and 
the  nonhomogeneous  system  (3.4)  has  the  performance  bound 


Now,  since  .4(1)  is  not  asymptotically  stable  and  (4(1),  /„)  is 
stabilizable,  it  follows  from  [37,  Proposition  3.2.  p.  67]  that  for 
some  x  £  ft", 

lim  je  ^0( I ,  f)x=  oo. 

/—  * 

Thus,  by  (5.17) 

lim  Jf  tQ(jj.)X  =  oo 

and  thus 


max  j  2  [tr  (&(«)/?<)  + 2  (tr  l,(»)X6&)c.»)  J  (512> 

where  n,  x  n,  nonnegative-definite  £5,(0)  and  P,(8)  satisfy 

O  =  A,(0)£,(0)  +  3,(0)>lf(0)  +  V„  (5.13) 

0  =  >1  J(8)P,(8)  +  P,mA,(8)  +  R,  (5. 14) 

and  r  x  r  Si  is  the  unique,  nonnegative  solution  to  (5.1). 

Proof:  First  note  that  since  robust  stability  is  independent  of 
the  disturbances,  we  can  set  V  =  /„  for  convenience  in  proving 
the  first  result.  Hence,  suppose  (3.1)  is  not  robustly  stable.  Since 
§  is  convex  (see  Remark  4. 1 ),  A  is  asymptotically  stable,  and  0  is 
continuously  arewise  connected,  'here  exist  G0  €  IS  and  §:[0,  1] 

[  -»  0  such  that  A(n)  =  A  (#(m))  +  pG0  is  asymptotically  stable 

for  all  n  E  [0.  1),  and  4(1)  is  not  asymptotically  stable.  Define 

Q(m,  i)  k  T  eAwseAT{i,uds,  taO,  M  E  [0,  1] 

*’o 

which  is  monotonically  increasing  in  the  nonnegative-defmite 
'  cone  with  respect  to  t.  Clearly,  the  limit 

QM  k  lim  Q(ji,  t),  n  E  [0,  1) 

t  —  OB 

exists  and  satisfies 

0  =  40x)e(M)  +  e0i)4r0i)  +  /B,  n  £  [0,  1). 

I 

Now  define  r  x  r  nonnegative  symmetric  Q.(n)  by 

where  Q,>(m)  €  ft"'  “"v  and  Q(n)  is  panitioned  as  in  (4.5).  By 
Corollary  5.1  with  6  =  8(#i).  G  =  nG0,  Q.  k  Q.(n),  m  G.  [0,  1), 

I  and  V  =  /„,  it  follows  from  (5.10)  that 

q,Wssi  m  e  to,  i).  (5.15) 

Hence,  by  (4.8),  (5.15)  implies 

II  COrill  r  =  II  Q.0*)ll r s  II  4» f .  M  €  [0.  1).  (5.16) 


lim  ||C(m)IIe=®-  (5-18) 

However,  (5.18)  contradicts  (5.16).  Hence.  (3.1)  is  robustly 
stable  over  f)  and  0. 

To  derive  (5.12)  note  that  since  R  is  block  diagonal. 


J(G.  8)  =  2  tr  Q,R,=  j  (vec  Q,)T  vec  R, 

>>i  <-i 

where  Q  satisfies  (3.7).  Furthermore,  (4.19)  implies 
vec  Q,=  -[A,(8)  ®  A,(.8))-' 


r 

VeC  y,+  S  vec  (G,tQla  +  Q,iG^) 

km  l 


Hence,  using  Lemma  2.1, 


7(G,  0)  =  2  tr(£,(0)/?,) 

im  I  L 

+  ^  <vec  \G*Qki+QikGTik\)T  vec  P,{d) 

*-i  J 

=  2  [tr  «?<<*>*-)  +  2  tr  A(«XO*0*,+  Q,kG  £)J 
*2  tr(£,(0)tf,) 

im  I  L 

+  2  (tr  A  m)o  max  (GikQtl  +  QtkG  Jj)  I 

*-i  J 

^2  tr  (£,(*)*,)+  2  (tr  P,(8))  2  <r™.(C1*)<WQ*, 
i- 1  L  *  ■  i 

s  2  U  «?,(«)/?,) +  2  (tr  P,(8))  J  9h  (G*)||G*If 

i- 1  L  *.i 


>] 
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f- 1  L 


(£.(0)*,)  +  2(trA(0))  ^  S 


i.* 


r 

=  2  [tr  (Qi(8)Rj)  +  2  (tr  A(*)XG&fc.<J 

f-  I 


where  v ,  o>,.  u>2  ^  0.  Furthermore,  let  0  =  {(?}  and 

s-U  •“] 

which  denotes  the  fact  that  the  local  subsystem  (oscillator) 
dynamics  are  assumed  to  be  known.  Since 


which  yields  (5.12). 


□ 


Omm(Aj  @  A,)  =  [4v2  +  (uJ~ui)2]>'1 


VI.  Examples 


define 


We  first  confirm  that  the  damped  harmonic  oscillator  is 
asymptotically  stable  for  all  constant  frequency  perturbations. 
Hence,  let 


and 


r=  1,  n  =  n ,  =  2 


u 

—  V 


__  Iv  [4p2  +  (o>,  -ui2)2]i/2 

[4p2  +  (u)| -o)j)2]*'2  2x 

Letting  V  -  lt  yields  V  =  2/j.  Solving  (5.1)  yields 

4(i.»*(2rJ£-  712721  +  yj3 )/2\  2r(v2S-  yi2y2i), 

4(1.2)  =  (7)2  +  72l)/'2'.'2(»>:£-  >1272)), 

4(2,2)  =  (2p2£-  >12721  +  Y2,)/2n/2p(p2^-  7i272i) 


where  v  >  0  and  u>  G  ill.  To  represent  frequency  uncertainty  let  D 
=  {0}.  0  =  R,  6  =  0,  and 

Note  that  A  (0)  is  stable  for  all  0  G  J1  with  poles  -  v  ±  jfa  +  6). 
Note  that  ^4(0)  can  be  diagonalized  by  means  of  the  unitary 
transformation 


«*>  =  — 
V2 


so  that 

A  (6)  s  £  -*'+-'o(*  +  9> 


0 

-p-y(«  +  0) 


Hence,  using 


A (0 )  ®  A (0 )  =  (<f> -  1  ®  0 - 1  )(.4(0 )  e  A(6 ))(0 ®  0 ) 
it  follows  that 


O4(0)®/K0))  =  2p,  0  G  R. 

Defining  (see  (4.15)] 

0  =  0<  i.i  i  =  2 1- 

and  8  =  0,  the  scalar  majorant  Lyapunov  equation  (5.1)  has  the 
solution 


$  =  \V2p 

where  V  =  |j  F||  F.  Choosing  V  =  /2  and  noting  that  =  (2  =  2p 
>  0  is  an  M  matrix,  Theorem  5.1  guarantees  robust  stability  for 
all  frequency  variations  0  G  R. 

The  next  example  has  been  chosen  to  demonstrate  the  robust¬ 
ness  of  a  pair  of  nominally  uncoupled  oscillators  with  respect  to 
uncertain  coupling.  Hence,  let 


where 


&  s  [1  +  62] 1  2,  6  s  (u|  —  ui2)/2v. 

Clearly,  §,  is  nonnegative  if  and  only  if 

Yi272i<»':£-  (6.1) 

The  bound  (6.1)  characterizes  the  magnitude  of  coupling  uncer¬ 
tainty  for  which  stability  is  guaranteed.  Note  that  the  parameter  6 
is  a  measure  of  the  frequency  separation  of  the  oscillators  relative 
to  the  damping.  When  S  ►  1.  (6.1)  becomes  asymptotically 

712721  I  <*>1-^2 1  (6.2) 

which  confirms  the  intuitive  expectation  that  robust  stability  is 
proportional  to  damping  and  subsystem  frequency  separation. 
This  result  does  not  appear  to  be  predictable  from  quadratic  or 
vector  Lyapunov  functions. 

To  evaluate  the  conservatism  inherent  in  the  bound  (6.1)  we 
solve  for  the  actual  stability  region.  To  render  the  calculation 
tractable  we  assume  that  G]2  and  G2l  have  the  structured  form 


By  constraining  (6.3)  the  set  of  coupling  variations  is  reduced, 
which  may  or  may  not  lead  to  a  larger  stability  region.  Thus,  our 
estimate  of  conservatism  may  itself  be  conservative,  i.e.,  the 
actual  conservatism  may  indeed  be  less  than  the  following 
analysis  indicates.  However,  without  (6.3)  the  development 
becomes  intractable.  This  calculation  will  thus  be  called  semiex- 
act. 

By  considering  the  characteristic  equation  for  A  +  C,  lengthy 
manipulation  shows  that  A  +  G  is  stable  if  and  only  if 

7)272)  <  2v2(  - 1  +  [1  +  62(1  -f2)]l/2)/(l  -t2)  (6.4) 

where  t  G  (0,  1]  is  the  smallest  positive  real  root  of 


n  =  4,  r  =  2,  n,  =  n2  =  2 


« =  ( 1  + 1 2)[  1  +  6  2(  1  -  € 2)) 1 ,2/[2  +  5 2(  1  - 1 2)] .  (6.5) 


and 


A,= 


j=l,2 


The  majorant  bound  (6.1)  and  semiexact  bound  (6.4)  are 
illustrated  in  unified  form  in  Fig.  1.  For  0  ►  1  note  that  €  = 
0(6' ')  and  thus  (6.4)  becomes  asymptotically 

Yl272l<H»|-«2l-  (6.6) 


■  •/- 


M 


Fig.  2. 


Hence,  for  large  6  the  majorant  bound  (6.2)  is,  at  worst, 
conservative  by  a  factor  of  2  compared  to  the  semiexact  bound. 

To  determine  the  performance  bound  (5.12)  set  R  =  It.  Hence, 
it  can  be  shown  that 


and  the  system  has  the  performance  bound 

®  =  +  '^2(Pii  +  />Jl)J/*f  1  ~2p\iP2l) 


=  2/v 


where 


hu  “  7i2/y/2*£'n,  p2l  =  yii/'/2rfl'i. 
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On  the  other  hand,  the  semiexact  calculation  yields 
Jm*>=  max  {Ip?2  +  />!,  +  2pi2P2jX  +  2£(p12P2j)j(1  -X2)]/ 

X€|0.l) 

[2£-4pi2p2,X-2£(pi2P2i)2(l  -XJ)]}.  (6.8) 

Fig.  2  compares  the  semiexact  worst-case  performance  (6.8)  to 
the  majorant  Lyapunov  equation  bound  (6.7).  To  efficiently 
illustrate  the  results  the  data  are  specialized  to  the  case  pl2  =  p2i 
Note  that  the  semiexact  performance  is  plotted  for  several  values 
of  6  because  of  the  explicit  dependence  of  (6.8)  on  S  via  8. 
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Abstract 

Over  the  past  decade  a  considerable  amount  of  attention  has  been  devoted  to  the  subject  of 
robustness  analysis.  However,  the  current  literature  on  robustness  analysis  concentrates  largely 
on  the  qualitative  issue  of  robust  stability.  To  date,  very  few  results  have  been  developed  for 
the  quantitative  issue  of  robust  performance.  An  exception  to  this  is  the  recent  work  of  Hyland 
and  Bernstein  in  covariance  majorant  analysis.  This  work  developed  bounds  on  cost  functions 
which  can  represent  the  variances  of  selected  system  variables.  This  paper  presents  improvements 
in  covariance  majorant  analysis.  Specifically,  less  conservative  (i.e.,  smaller)  upper  bounds  are 
developed  for  the  cost  functions.  Lower  cost  bounds  are  also  developed. 
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0038. 


Recent  technologies  have  required  the  modeling  and  control  of  increasingly  complex  systems 
such  as  flexible  space  structures,  electric  power  systems,  large  scale  manufacturing  systems,  and 
flexible  manipulators.  Correspondingly,  there  is  an  obvious  need  for  analysis  tools  which  can 
qualitatively  and  quantitatively  describe  the  behavior  of  these  systems  in  the  face  of  uncertainties 
in  the  representative  mathematical  models.  Thus,  over  the  past  decade  there  have  been  considerable 
interest  among  the  systems  research  community  in  robustness  analysis  for  multivariable  sysems. 
(See  for  example  [14,15]). 

However,  although  significant  attention  has  been  given  to  the  issue  of  robustness  analysis, 
the  current  literature  concentrates  largely  on  the  qualitative  issue  of  robust  stability.  To  date 
very  little  work  has  been  published  on  the  quantitative  issue  of  robust  performance.  One  notable 
exception  is  the  application  of  the  fi  function  [2]  to  performance  analysis.  In  [2]  performance  is 
measured  in  terms  of  the  norm  of  a  specified  performance  matrix,  such  as  the  output  or  input 
sensitivity  matrix.  However,  this  is  only  one  possible  performance  measure.  For  example,  one  is 
often  interested  in  time-domain  performance  measures  which  are  expressed  in  terms  of  the  transient 
or  steady  state  behavior  of  selected  system  variables  (e.g.,  inputs  and  outputs)  when  the  system 
is  subjected  to  specified  signals  and  disturbances.  Covariance  majorant  analysis  [l]  another  recent 
recent  development  in  robustness  analysis  does  measure  system  performance  in  terms  of  steady 
state  behavior. 

Specifically,  covariance  majorant  analysis  considers  linear  interconnected  systems  which  have 
structured  parametric  uncertainty  and  are  subject  to  white  noise  disturbances.  The  analysis  of  [l] 
then  develops  a  robust  stability  condition  and  upper  bounds  on  the  variances  of  selected  system 
variables.  In  the  present  paper  it  is  shown  how  covariance  majorant  analysis  leads  to  both  lower 
and  upper  robust  performance  bounds.  The  upper  bounds  developed  here  are  less  conservative 
(i.e.,  smaller)  than  those  of  [l]. 

The  paper  is  organized  as  follows.  Section  2  briefly  reviews  the  developments  of  [1]  and  presents 
results  which  are  needed  in  the  analysis  of  the  next  section.  Section  3  then  develops  the  new  bounds. 
The  reduced  conservatism  of  the  new  bounds  is  illustrated  by  the  example  of  Section  4.  Section  5 
then  presents  concluding  remarks. 


Before  proceeding  some  notation  and  definitions  are  presented. 


h 

Zij  or  %*) 

Zii 

diag  (zr,...,zTO) 

block-diag  (Zi . ZM) 

Y  *Z 


ZHI 

coU(Z) 

vec(z) 


Y®Z 

Y®Z 

Y  <<  Z 

nonnegative  matrix 
tr  Z 

G’min  (Z),vm„(Z) 
11*11# 

11*11# 

ll*IU 


pxp  identity  matrix 

(t,j)  element  of  matrix  Z 

(t  ,j)  matrix  block  of  partitioned  matrix  Z 

diagonal  matrix  with  listed  diagonal  elements 

block-diagonal  matrix  with  listed  diagonal  blocks 

[y ijZij],  Hadamard  product  of  matrices  Y,Z  of  equal  dimensions 

[12-13] 

[l/z»j']>  Hadamard  inverse  of  square  matrix  Z 
ttK  column  of  matrix  Z 
f  coli(«)~l 


|_co1p(*)J 

[y ijZ] ,  Kronecker  product  of  matrices  Y  and  Z  [10-1 1] 

Y  ®  Ip  +  Im  ®  Z,  Kronecker  sum  of  matrices  Y  €  IRmxm  and 


z  e  m***  [lo-n] 

Yij  <  Zij  for  each  »  and  j 

matrix  with  nonnegative  elements  [Z  >>  0) 

trace  of  matrix  Z 

smallest  and  largest  singular  values  of  matrix  Z 
spectral  norm  of  matrix  Z  (=  <rmmK{Z)) 

Frobenius  norm  of  matrix  Z  (||iT||J.  =ED4i) 

»  3 

absolute  norm  of  matrix  Z{=  max|zjy|) 


Let  Z  be  the  n  x  n  block-partitioned  matrix 


Z  —  [£»j](*,y=»,...,r)  (11) 

r 

where  Zij  £  IRn’ x  ny  and  =  n.  The  block  norm  matrix  [7,3]  of  Z  with  respect  to  the  matrix 

t=i 

norm  ||  •  |f«  (which  is  also  called  the  u9  block  norm i”)  is  the  r  x  r  nonnegative  matrix 

Z.  =  [Z],  ^  [IIZ.,11,]^, . (1.2) 

Thus,  Z  s  and  Z p  represent  respectively  the  block  norm  matrices  of  Z  with  respect  to  the  spectral 
and  Frobenius  norms. 
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Majorants  [8]  are  essentially  upper  bounds  for  block  norm  matrices.  Precisely,  Z  €  IRrxr  is  a 
majorant  of  Z  (with  respect  to  the  norm  ||  •  ||<)  if 

Z,  <<  Z.  (1.3) 

A  matrix  P  €  JRpXp  is  an  M-matrix  [4-6]  if  it  has  nonpositive  off  diagonal  elements  [i.e.,  pij  <  0 
for  «  7^  j]  and  positive  principal  minors.  There  are  many  equivalent  definitions  for  an  M-matrix. 
(See  [4]-[6]). 

2.  Preliminaries 

Consider  the  system 

x(t)  =  (A+G)x(t)  +  w(t)  (2.1) 

where  x  G  IRn  and  w  is  a  white  noise  process  with  intensity  V.  It  is  assumed  that  the  system  (2.1) 
represents  r  (r  <  n)  nominally  stable  subsystems  described  by  A  with  uncertain  interactions  and 
dynamics  described  by  G.  Specifically, 


A  —  block-diag{At}J_1 

(2.2) 

r 

where  Ai  €  IR”’ xn<  is  asymptotically  stable  and  =  n.  The  matrices  G,V 

•  •  i  1 1  >zi 

partitioned  conformably  so  that 

G  IRnxn  are 

G  =  (G<j](»,j=l . r) 

(2.3a) 

II 

| 

I.. 

n 

*i 

(2.3b) 

where  Gj3,  V,y  €  IR,,<xni  .  In  addition, 

GeG 

(2.4) 

where 

G  =  {G  €  IRnXn  :  G,  <<  G}. 

(2.5) 

That  is  the  spectral  norm  of  each  block  G,y  of  the  uncertainty  matrix  G  is  bounded  above  by  the 
corresponding  (i,j)  element  of  the  nonnegative  matrix  G  e  IRrXr.  Thus  G  is  a  majorant  of  each 
admissible  G. 

If  A  +  G  is  asymptotically  stable,  then  the  state  covariance  Q  is  the  unique  solution  of  the 
Lyapunov  equation 

0=  (A  +  G)Q  +  Q(A  +  G)r  +  V'.  (2.6) 
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Q  is  partitioned  conformably  with  A,  G  and  V  so  that 


Q  —  =  1 . r)  (2.7) 

where  Qi}  €  IRn<xn». 

Now  define  the  positive  matrix  A  €  IRrXr  by 

=  ©  •At)>  *»  j  =  1>  •  •  •  ,  T.  (2-8) 

Also,  define  A  €  IRr3xrl  as 

A  =  (diag(vecA)]  -  d  ©  G.  (2.9) 

These  matrices  appear  in  the  following  lemma  which  presents  the  covariance  Frobenius  block  norm 
inequality  initially  proved  in  [l].  An  alternative  proof  based  on  the  block  Kronecker  product  is 
found  in  [3]. 

Lemma  2.1.  Consider  G  €  G  such  that  A+G  is  asymptotically  stable  and  let  Q  be  the  solution 
of  (2.6).  Then  QF  satisfies  the  matrix  inequality, 

A*Qr<<  +  QfGT  +  Vf  (2.10) 

which  is  equivalent  to  the  vector  inequality 

AvecQF  <<  vecVf.  (2.11) 

Definition  2.1.  The  pair  (A,  G)  is  stable  if  A  defined  by  (2.9)  is  an  M-matrix. 

If  (2.10)  is  interpreted  as  an  equality,  one  obtains  the  Lyapunov-like  equation 

A*Q  =  GQ  +  QGt  +  Vf.  (2.12) 

or  equivalently 

AvecQ  =  vecVf.  (2-13) 

Since  A  is  an  N-matrix  [5j  (i.e.,  it  has  nonpositive  off-diagonal  elements),  it  is  invertible  with 
A  1  >>  0  if  and  only  if  it  is  an  M-matrix  [4-6].  The  following  result  then  follows  immediately 
from  the  equivalence  of  (2.12)  and  (2.13). 

Lemma  2.2.  The  pair  (A,G)  is  stable  if  and  only  if  for  any  V F  >>  0,  there  exists  a  unique 
(nonnegative)  solution  of  Q  of  (2.12). 
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H 


Remark  2.1.  Q  may  be  computed  by  inverting  the  r*  x  r 1  matrix  A  in  (2.13).  Alternatively,  it 
is  shown  in  [l],  that  Q  —  limt_»00  where  >>  0  and  the  monotonically  increasing  sequence 
|  is  generated  by 


A  *  Qi+1  -  (Jr  *  G)Q<<+1>  -  Qli+1)(Ir  *  G) 

=  (G  —  Ir  *  G)QW  +  QW(G  -  Ir  *  G)t  +  VF ,  t  =  0,1,. . . 

or  equivalently 


(2.14) 


g(i+1)  —  {A  -  G  -  Gt)hi  *  [(G  -  IT  *  G)g(0  +  QC0(G  -  Ir  *  G)t  +  Vf],  t  =  0, 1, . . .  (2.15) 
where  G  G  IRrxr  is  defined  by 

3*]=9a,  i,j=l,...,r.  (2.16) 


The  following  comparison  result  shows  that  Q  is  actually  a  majorant  of  the  state  covariance 
Q.  A  proof  of  this  result  is  presented  in  [lj.  A  simplified  proof  is  given  here. 

Lemma  2.3.  Suppose  (A,G)  is  stable  and  let  Q  be  the  solution  of  (2.12).  Then,  for  each  G  gG 
such  that  A  +  G  is  asymptotically  stable,  the  solution  Q  of  (2.6)  satisfies 


Qr<<Q- 


(2.17) 


Proof.  Since  QF  satisfies  (2.10),  it  follows  that  for  some  nonnegative  U  G  IRrXr 

A*QF  =  GQF  +  QFGT  +  VF  -  U.  (2.18) 

Subtracting  (2.18)  from  (2.12)  yields 

A*{Q-Qf)  =  G(Q  -  Qf)  +  {Q~  Qf)GT  +  u.  (2.19) 

It  then  follows  from  Lemma  2.2  that 

Q  -  Qf  >>  0-  (2.20) 


The  proof  of  the  next  result  on  stability  robustness  is  based 


on  Lemma  2.3  and  is  presented  in 


[!]• 


Theorem  2.1.  Consider  the  system  described  by  (2.1)-(2.5)  and  assume  {A, 6)  is  stable.  Then 
for  each  G  €  G  the  plant  matrix  A  +  G  is  asymptotically  stable. 
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Although  Theorem  2.1  is  a  useful  result  in  covariance  majorant  analysis,  an  equally  important 
result  is  that  the  majorant  analysis  allows  one  to  obtain  an  upper  bound  on  the  variances  of  selected 
system  variables.  Thus,  in  what  follows  the  cost  function 

J(G)  =  tr  QR,  R  =  Rt>  0  (2.21) 

is  considered  where  R  has  the  partitioned  form 

. .  (2  22) 

and  Rij  €  IRn<  * n> .  This  cost  function  can  represent  the  variance  of  one  of  the  system  variables. 
For  example  if  a  given  by 

a  =  eTx,  c  €  IRrt  (2.23) 

is  a  system  variable  of  interest,  then 

R  =  cct=>  J{G)  =  E(aa).  (2.24) 


Now  define 


J min  ~ 

J mfcx  =  max  J(G). 

oeG 


(2.25) 

(2.26) 


Definition  2.2.  If  for  the  system  described  by  (2.1)-(2.5),  Jm;„  >  at  and  Jmmx  <  /?,  then  a  is  a 
lower  performance  bound  and  f}  is  an  upper  performance  bound. 

In  [1]  majorant  analysis  was  used  to  develop  an  upper  performance  bound  Pi  for  the  special 
case  in  which  R  is  block-diagonal  (i.e.,  Rij  =  0  for  *  ^  j).  This  result  is  presented  below  in  Theorem 


Before  presenting  this  theorem  define  the  nominal  state  covariance  Q°  €  IRnXn  to  be  the 
unique,  nonnegative  definite  solution  of  the  Lyapunov  equation 


0  =  AQ°  +  Q°At  +  V. 


Q°  has  the  partitioned  form 


(2.27) 


<r  -  Ryw-wi  (2-28) 

where  Q°}  €  IRnv x n> .  Also,  for  i  =  l,...,r  define  P°  €  lRn*xn<  to  be  the  unique  nonnegative 


definite  solution  of 


0  =  A?P°  +  P?A<  +  Ru. 


(2.29) 
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Theorem  2.2.  Assume  ( A,G )  is  stable.  Then  for  each  G  E  G,  A+G  is  asymptotically  stable.  In 
addition,  if  R  is  block-diagonal  then  the  system  described  by  (2.1)-(2.5)  has  the  upper  performance 
bound 

r 

0i  =  ti  Q°R  +  2  £(tr  f?)(GQ)M  (2.30) 

»=i 

where  Q,Q°  amd  P°  are  the  respective  solutions  of  (2.12),  (2.27)  and  (2.29). 

3.  Improved  Peformance  Analysis 

The  upper  performance  bound  0\  presented  in  Theorem  2.2  is  based  upon  developing  a  ma- 
jorant  Q  of  the  state  covariance  Q  by  beginning  with  (2.6),  the  Lyapunov  equation  in  Q.  In  this 
section  Q  is  expressed  as 

Q  =  Q°  +  AQ  (3.1) 

where  Q°  is  the  solution  of  (2.27).  Subtracting  (2.27)  from  (2.6)  and  using  (3.1)  yields 

0  =  (A  +  G)AQ  +  AQ(A  +  G)T  +  GQ°  +  Q°GT.  (3.2) 

The  perturbation  AQ  has  the  partitioned  form 

AQ  =  [AQiy](,iJ=i . r)  (3.3) 

where  AQij  €  IRn,  xn».  In  what  follows  it  is  shown  that  by  using  (3.2)  to  develop  a  majorant  AQ 
of  AQ,  it  is  possible  to  develop  a  less  conservative  (i.e.  smaller)  upper  performance  bound  than 
that  of  Theorem  2.2.  In  addition,  the  analysis  of  this  section  develops  a  lower  performance  bound 
which  has  no  counterpart  in  [1]. 

Consider  any  two  matrices  M,N  e  IRnxn  partitioned  identically.  Then  as  shown  in  [3], 


[A/  +  •AT]/'  <<  Af f  +  N f 

(3.4a) 

(Af3v)r  <<  M.'Nf 

(3.4b) 

<<  A {pNs- 

(3.4c) 

Using  (3.4)  it  follows  that  for  each  GeG, 

[GQ°  +  Q°Gt]f  <<  [GC?0],-  +  \Q°Gt\f 

<<GsQ0f  +  Q0fGTs 

<<GQ°f  +  QfGt. 

(3.5) 
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Lemma  3.1  which  presents  Frobenius  block  norm  inequalities  for  Q°  and  A Q  is  now  an  immediate 
result  of  Lemma  2.1  and  (3.5). 

Lemma  3.1.  Consider  GeG  such  that  A  4-  G  is  asymptotically  stable  and  let  Q°  and  A  Q  be 


the  unique  solutions  of  (2.27)  and  (3.2).  Then  Q°F  and  A QF  satisfy 

A*Q°f<<Vf  (3.6a) 

A  *  A Qf  <<  G  AQ  F  +  AQFGT  +  GQj ?  +  QFGT .  (3.6b) 

Now  interpret  (3.6)  as  equalities  to  obtain 

A*Q°  =  Vf  (3.7a) 

A  *  AQ  =  GAQ  +  AQGt  +  GQ°F  +  QFGT.  (3.7b) 


Lemma  3.2  which  shows  that  Q°  and  AQ  are  majorants  of  Q°  and  AQ  follows  immediately  from 
Lemma  2.3. 

»  A  A  A 

Lemma  3.2.  Suppose  ( A,G )  is  stable  and  let  Q°  and  AQ  be  the  (unique,  nonnegative)  solutions 
of  (3.7).  Then  for  each  G  €  G  such  that  A  +  G  is  asymptotically  stable,  Q°  and  AQ,  the  respective 
solutions  of  (2.27)  and  (3.2)  satisfy 

Qf<<Q°  (3.8a) 

AQf  <<  AQ.  (3.8b) 

An  important  result  is  now  presented.  This  result  reveals  that  the  sum  Q°F  +  AQ  is  a  smaller 
majorant  of  the  covariance  Q  than  is  Q.  This  result  is  subsequently  used  to  develop  lower  and  upper 
performance  bounds  a 2  and  /?2  and  to  demonstrate  the  reduced  conservatism  of  /?2  compared  to 
the  performance  bound  described  in  Theorem  2.1. 

Lemma  3.3.  Suppose  ( A,G )  is  stable  and  let  Q  and  AQ  be  the  (unique,  nonnegative)  solutions 
respectively  of  (2.12)  and  (3.7b).  Then  for  each  G  €  G,  Q  and  Q°  the  solutions  respectively  of 
(2.6)  and  (2.27)  satisfy 

Qf  <<  Qf  +  AQ  <<  Q.  (3.9) 

Proof.  It  follows  from  (3.1),  (3.4a)  and  (3.8a)  that 

Qf  =  [Q°  +  AQ]f  <<  Qf  +  AQf  <<  Qf  +  &Q  (3-10) 
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which  proves  the  left  hand  inequality  in  (3.9). 

■  a 

Now,  let  Q  be  the  (unique  nonnegative)  solution  of 

A*  A($  =  GA$  +  A §Gt  +  GQ°  +  Q°GT. 

(3.11) 

■ , 

Subtracting  (3.7b)  from  (3.11)  yields 

A  *  ( A<$  -  A Q)  =  G{ A<$  -  A Q)  +  (A<$  -  A Q)GT  +  G(Q°  -  QF)  +  (Q°  -  QF )GT. 

(3.12) 

■ 

Since  Q°  >>  Q°F, 

G(Q°-Qf)  +  {Q°-Q0f)Gt>>  0. 

(3.13) 

It  then  follows  from  (3.12),  (3.13)  and  Lemma  2.2  that 

■  ‘ 

A Q  <<  A<$. 

(3.14) 

Adding  (3.7a)  and  (3.11)  yields 

■  B 

A*(Q°  +  A<J)  =  G(<$°  +  A<$)  +  (Q°  +  A  Cl)GT  +  VF. 

(3.15) 

Comparing  (3.15)  and  (2.12)  reveals  that 

■  i 

Q°  +  A<$  =  Q. 

(3.16) 

Thus,  using  (3.8a),  (3.14)  and  (3.16)  yields 

p 

Q°f  +  AQ  <<  Q°  +  AQ  <<  Q°  +  A<$  =  Q 

(3.17) 

which  proves  the  right  hand  inequality  in  (3.9). 

Notice  that  substituting  (3.1)  into  (2.21)  yields 

• 

J{G)  =  J°  +  A  J{G) 

(3.18) 

where 

• 

J°  =  tr  Q°R 

(3.19) 

A  J(G)  =  tr  AQR. 

(3.20) 
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r 


Substituting  into  (3.20)  the  partitioned  forms  of  R  and  A Q  given  respectively  by  (2.22)  and 
(3.3)  gives 

r  r  r 

AJ(G)  =  TTtr  AQ*R*  +  ££tr  (3.21) 


*=i 


*  =  1  J-» 

j+i 


An  alternative  expression  for  the  first  summation  in  (3.21)  is  presented  below  in  Lemma  3.4. 

Lemma  3.4.  Consider  the  system  described  by  (2.1)-  (2.5)  and  assume  A+G  is  asymptotically 
stable.  Then  A J{G)  given  by  (3.21)  can  be  expressed  as 


^(C)  =  E  Etr  +  «< iGj)  + E  E  " 

«=i j-i 


(3.22) 


»=1  3-1 
>**» 


Proof.  The  perturbation  A Q  solves  (3.2)  which  by  using  (3.1)  can  be  expressed  as 

0  =  AAQ  +  A  QAt  +  GQ  +  QGT.  (3.23) 


Using  the  partitioned  forms  of  the  matrices  amd  considering  the  (i,t)  block  of  (3.23)  gives 

r 

0  =  AiAQu  +  A  QaAj  +  +  QyGg). 

i- 1 


(3.24) 


Then  by  using  the  appropriate  Kronecker  product  identities  [10—  11]  (3.24)  can  be  expressed  as 

r 

vecA Qa  =  -( Ai  ©  A,)-1  ]Pvec {GijQa  +  QijGfj).  (3.25) 

j=i 


Recognize  that  for  any  two  square  matrices  Y  and  Z 


tr  Y Z  —  (vecy)TvecZ. 


Then  using  (3.25)  and  (3.26)  gives 


tr  A Q«Ru  =  -  J^JvecfGyQ*  +  Q<,G^)]r(A,  ©  Ai)~TvecRu. 

i=i 


(3.26) 


(3.27) 


But  it  follows  from  (2.29)  that 


vec P?  =  {Ai  ®  A*)  TvecRu 


and  so 


tr  A QuRii  =  -  £[vec(G,yQy,  +  Q^G^fvecP* 
j=i 
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(3.28) 


(3.29) 


« 


which  by  using  (3.26)  can  be  expressed  as 


tr  A QuRu  =  tr  +  QijGTj)-  (3.30) 

The  proof  is  completed  by  substituting  (3.30)  into  (3.21). 

The  main  results  of  this  paper  are  given  below  as  Theorem  3.1  and  Corollaries  3.1  and  3.2. 
Before  presenting  this  result  two  important  trace  inequalities  are  given.  First,  for  P  €  IR,,*P  define 
the  matrix  I  norm  by 

P’11/ =  Z£  I  r*  I-  (3.31) 

.=1  i=l 

Proposition  3.1.  For  each  M  6  IRpX,  and  P  &  IR,xp> 

|  tr  MP  |<  jlMlUIIPH/.  (3.32) 


Proof. 

|«r  MP\  =|  EEm./Pj,  I 

»-l  J  =  1 

^  Z)Z)  i  ii  p*  i 

»=1 3=1 

<  HAf|UI|P||/. 

If  certain  structures  of  M  and  P  are  known,  a  much  less  conservative  upper  bound  on  |  tr  MP  \ 
may  be  given.  The  next  result  is  derived  in  [9j. 

Proposition  3.2.  Consider  M,P  €  IRpXp  such  that  M  =  MT  >  0.  Then 


I  tr  MP  |<  (tr  Af)||P||.. 


(3.33) 


Now  the  main  results  of  this  paper  are  presented. 

Theorem  3.1.  Suppose  ( A,G )  is  stable.  Then  A  +  G  is  asymptotically  stable  for  each  G  £G 


and 


where 


max  |  A J(G)  |<  A J 
C?6G 


AJ  =  2^(tr  P°)  (C(Q’F+AQ))  +EE 

t=l  t  =  l  i-I 

$ 


(3.34) 

(3.35) 
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Proof.  The  asymptotic  stability  of  A  +  G  is  simply  a  restatement  of  Theorem  2.1.  So  for  each 
G  €  G  consider  the  cost  perturbation  A  J{G)  described  by  (3.22)  and  recognize  that 


|  AJ(G)|<|  AJa(G)|  +  |  AJb(G)| 


where 


I  AJx(G)  l<  E  E I tr  Pi&iQfi  +  QhGfi)  I 

*= 1  j=  1 

r  r 

\AMG)\<Yl'52\tt  i 
<=1  « 

Using  (3.33)  and  (3.9)  it  follows  that  for  each  G  €  G 

|  tr  PiiGijQji  +  QijGJi  \  <  (tr  /?)||Giy<3yi  +  QijG^W 

<  2(tr  J?)||<?<y||.||<?y<||. 

<  2(tr  i?)||G*|U||Q*||, 

<  2(tr  Pi)G{ij)  [(Q^)(y,.)  +  (AQ)(yi0] 

which  substituting  into  (3.37a)  gives 

I  A JA{G)  |<  2  £( tr  J*)  (C(QJ  +  AQ))  . 


i=i 


(».0 


Also,  using  (3.32)  and  (3.8b)  it  follows  that 

|  tr  AQijRji  |  <  ||Ag,y||x||%||/ 

<  ||AQ«yI|f  ||flyt||/ 

—  A<?(t,y)||f2y*||/ 

which  substituting  into  (3.37b)  gives 

I  l<  £X><W*A- 


»=1  J-» 

i+i 


The  proof  follows  from  (3.36),  (3.38)  and  (3.39). 


(3.36) 

(3.37a) 

(3.37b) 


(3.38) 


(3.39) 


Remark  3.1.  One  may  be  tempted  to  apply  the  inequalities  (3.8b),  (3.32)  and  (3.33)  to  the 
expression  for  A  J[G)  given  by  (3.21).  This  yields 


max  I  A J(G)  |<  A J 
G€  G 


(3.40) 
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where 


(3.41) 


I 


8 


I 


Ai  =  **)aq(.-  o  +  EEll^lUAQ(0)- 

»=i  «=i  >-» 

i+i 

However,  it  can  be  shown  that 

A }  >  AJ  (3.42) 

such  that  A  J  is  a  more  conservative  bound  for  the  magnitude  of  the  cost  perturbation  than  is  A  J. 
It  is  easily  seen  from  (3.18)  that 

J°-  |  A J(G)  |<  J(G)  <  J°+  |  A J{G)  |  (3.43) 

where  J°  is  given  by  (3.19).  The  following  corollary  is  then  immediate. 

Corollary  3.1.  Under  the  conditions  of  Theorem  3.1  the  system  described  by  (2.1)-(2.5)  has 
the  lower  performance  bound  as  and  the  upper  performance  bound  given  by 

aj  =  tr  (Q°R)  -  A  J  (3.44) 

Pi  —  tr  (Q°R)  +  AJ  (3.45) 

where  A  J  is  given  by  (3.35). 

Remark  3.2.  It  is  important  to  recognize  that  the  results  of  Theorem  3.1  and  Corollary  3.1 
actually  allow  multiple  objective  analysis.  For  example  if  the  analyst  is  interested  in  m  costs 

Ji{G)  =  tr  QR{i),  i  =  l,...,m  (3.46) 

representing  say  the  variances  of  m  system  variables  then  Corollary  3.1  yields  lower  and  upper 
bounds  a^  and  such  that  for  each  G  €  G, 

a(i)  <  Ji(G)  <  P(i\  i  =  (3.47) 


The  next  corollary  compares  the  upper  performance  bounds  of  Theorem  2.2  and  Corollary  3.1 
for  the  case  in  which  R  is  block-diagonal. 

Corollary  3.2.  Assume  that  R  is  block-diagonal.  Then  under  the  conditions  of  Theorem  3.1 
the  upper  performance  bounds  Pi  and  02  given  respectively  by  (2.30)  and  (3.45)  satisfy 

Pi  <  Pi-  (3.48) 
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In  addition,  if 


Q°=Q°r 

(3.49) 

then 

II 

(3.50) 

Proof.  Subtracting  (2.301  from  (3.45)  vields 

- 

r 

07  ~  fix  =  2 £>r  p?)  (6(Q°f  +  AQ-  Q)) . 

(3.51) 

It  then  follows  from  (3.9)  that 

— 

Q°F  +  AQ-Q  <<0 

(3.52) 

which  implies  that 

07  ~  01  <  0- 

(3.53) 

Now  assume  (3.49)  holds.  It  then  follows  from  (3.12)  that 

<3 

II 

««Or 

< 

(3.54) 

Using  (3.49),  (3.54)  and  (3.16)  gives 

— 

Q°f  +  AQ  =  Q°  +  AQ  =  Q°  +  A$  =  Q 

(3.55) 

which  substituting  into  (3.51)  reveals 

— 

o 

II 

** 

l 

« 

(3.56) 

4.  An  Example 

This  example  considers  the  robustness  of  a  pair  of  nominally  uncoupled  oscillators  with  respect 
to  uncertain  coupling.  Specifically,  consider  the  system  described  by  (2.1)-(2.5)  with 


A,  = 


V  =  block-diag 


=  4, 

r  =  2, 

ni 

=  n  j  =  2 

-.1 

1  ' 

r-.2  2  1 

.  -1 

-  .1, 

> 

1 

w 

1 

>  — 

1  .8 

.8  1 


1  .8 

.8  1 


) 


(4.1) 

(4.2) 

(4.3) 
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'  0  .1' 

.1  0  . 


Notice  that  the  eigenvalues  of  A\  and  Aj  are  given  by 

WAi)],.,  =  --l±y  (4-5) 

W'>1)|1.,  =  -.2±j2.  (4.6) 

The  matrix  A  defined  by  (2.9)  is  an  M-matrix  and  thus  the  system  is  stable  for  each  G  that  satisfies 

G,  <<  G.  (4.7) 

Now  consider  the  quadratic  performance  J{G)  defined  by  (2.1)  with 

R  =  /4.  (4.8) 

The  results  of  the  robust  performance  analysis  are  presented  in  Table  4.1.  The  values  Jl  and  Js 
were  obtained  by  generating  a  set  Gjj  of  10,000  random  G  matrices  satisfying 


ft 

and  letting 

G,~G 

(4.9) 

Jl  =  max  J(G) 
oe  g* 

(4.10a) 

1 

Obviously, 

Js  —  min  J(G). 
oeG* 

(4.10b) 

Jl  <  Jm*x  =  max  J(G) 

Crtvi 

(4.11a) 

j S  >  J min  =  min  J(G). 

(4.11b) 

It  is  conjectured  that 

J L  —  Jm*x 

(4.12a) 

Js  —  J  min 

(4.12b) 

and  thus  Jl  are  useful  indicators  of  the  conservatism  inherent  in  the  performance  bounds  0\,0j 
and  c*jj . 

The  parameter  Jl  predicts  that  Jmmx  is  6.81%  greater  than  the  nominal  performance  J° .  The 
performance  bounds  0\  and  02  respectively  indicate  that  Jmax  may  be  as  much  as  30.4%  or  23.8% 
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greater  than  the  nominal  value.  Thus  in  this  example,  the  new  upper  performance  bound  Pi  is 
significantly  less  conservative  than  the  original  upper  bound  Pi . 


Table  4.1 


nominal  performance,  J° 

15.0000 

upper  performance  bound,  Pi 

18.5704 

upper  performance  bound,  Pi 

19.5579 

largest  random  performance,  Jx, 

16.0208 

lower  performance  bound,  Qj 

11.4296 

smallest  random  performance,  Js 

14.6103 
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Abstract 


Complex  and  large  scale  systems  are  often  viewed  as  collections  of 
interacting  subsystems.  Properties  of  the  overall  system  are  then  deduced 
from  the  properties  of  the  individual  subsystems  and  their  interconnections. 
This  analysis  process  for  large  scale  systems  usually  requires  manipulating 
the  matrix  subblocks  of  block-partitioned  matrices.  IWo  tools  which  have 
found  use  in  linear  systems  analysis  are  the  Kronecker  product  and  the 
matrix  modulus  (|a^|).  However,  these  tools  are  designed  for  matrices 

partitioned  into  their  scalar  elements.  Thus,  this  paper  defines  and 
presents  properties  of  the  block  Kronecket  product  and  block  norm  matrix, 
generalizations  of  the  Kronecker  product  and  matrix  modulus  to  block- 
partitioned  matrices.  The  utility  of  the  results  is  illustrated  by  deriving 
in  simplified  fashion  a  recent  result  in  robustness  analysis. 
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Introduction 


In  the  analysis  of  complex  and  large  scale  dynamic  systems  it  is  often 
advantageous  to  regard  the  overall  system  as  a  collection  of  interacting 
subystems.  Properties  of  the  aggregate  system  can  then  be  deduced  from  the 
properties  of  the  individual  subsystems  and  their  interconnections. 

(See  e.g.  [6.7,11,1a]  for  a  small  sample  of  the  numerous  published  results 
which  take  this  approach.)  For  linear  systems  this  type  of  analysis  often 
involves  manipulating  the  matrix  subblocks  of  block-partitioned  matrices. 

Some  tools  that  have  been  useful  in  systems  analysis  are  the  Kronecker 
product  and  the  matrix  modulus.  The  Kronecker  product,  for  example,  has 
found  use  in  the  solution  of  linear  matrix  equations  [1,4.10,17],  the 
development  of  matrix  calculus  [4,9,13,16]  and  dynamic  sensitivity  analysis 
[3,4] .  However,  the  Kronecker  product  was  designed  for  matrices  partitioned 
into  their  scalar  elements.  For  example  if  A,  Q,  and  B  are  matrices,  then 
the  Kronecker  product  allows  one  to  write 

vec(AQB)  =  (B^®A)vec(Q)  (1.1) 

where  vec(  •  )  is  the  vector  valued  operator  which  stacks  the  columns  of  a 
matrix  in  a  vector.  However,  suppose  Q  were  partitioned  into  matrix 
subblocks.  Then  the  operation  (1.1)  destroys  this  structure. 

The  matrix  modulus  of  the  matrix  Q  is  the  matrix  |q„ I  and  has  been 
used  to  develop  robust  stability  conditions  for  dynamic  linear  systems 
[11,18].  However,  if  Q  is  partitioned  into  matrix  subblocks,  the  matrix 
modulus  is  too  fine  in  that  it  is  based  on  a  property  (the  absolute  value) 
of  the  scalar  elements  of  a  matrix.  Conversely,  a  norm  llQllg  of  the  matrix 
Q  is  too  coarse  in  that  it  totally  ignores  the  block-partitioned  structure 
of  the  matrix. 

What  are  obviously  needed  are  tools  designed  specifically  for  block- 
partitioned  matrices.  One  such  collection  of  tools  has  been  based  on  matrix 
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majorants  and  minorants  [5].  The  purpose  of  this  paper  is  to  develop 
additional  results  based  on  the  block  Kronecker  product  and  the  block  norm 
matrix,  generalizations  respectively  of  the  Kronecker  product  and  modulus 
matrix  to  block-partitioned  matrices. 


The  paper  proceeds  as  follovs.  In  Section  2  the  block  Kronecker 
product  is  introduced  and  some  of  its  algebraic  properties  are  presented. 
Then,  in  Section  3  the  block  norm  matrix  is  defined  and  some  related 
equalities  and  inequalities  are  given.  Next,  Section  A  presents  results  on 
block-diagonal  and  diagonal  matrix  structures.  These  results  are  useful  in 
Section  5,  which  uses  results  developed  in  the  previous  sections  to  derive 
in  a  simplified  fashion  the  covariance  block  norm  inequality  of  [7, 
Proposition  4.2] . 


Before  proceeding  we  present  some  notation.  It  is  assumed  that  the 
matrices  are  in  general  complex. 


I 

P 

* 


®  .  © 

coli(Z) 


vec (Z) 


Z 

Z 


T 

H 


z .  . 


3-3 

Z  <<  Z 


pxp  identity  matrix 
Hadamard  product  [15] 

Kronecker  product,  Kronecker  sum 
ith  column  of  matrix  Z 

r  coi  (z)  1 

col2(Z) 


,  Z  is  a  pxq  matrix 


[4.8] 


[  COlq(Z) J 
transpose  of  matrix  Z 

conjugate  transpose  of  matrix  Z 

(i,j)  element  of  matrix  Z 

z..  <  z..  for  all  i  and  j 

matrix  with  nonnegative  elements  (Z  >2  0) 


nonnegative  matrix 
tr(Z) 


trace  of  matrix  Z 


k.  (z).  A( z) 

min  max 

(tA.Z) 

or  .  (Z),  O'  (Z) 
min  max 


minimum  and  maximum  eigenvalues  of  Hermit ian  matrix  Z 
singular  value  of  matrix  Z 

smallest  and  largest  singular  values  of  matrix  Z 

any  norm  of  matrix  Z  (not  necessarily  induced  by  a 
vector  norm) 

any  norm  of  matrix  Z  induced  by  a  vector  norm  | |  •  |  \a 
( I  |Z|  L  =  max  llZyll  ) 

0  1  lync,=i 

Euclidean  norm  of  vector  y 

Spectral  norm  of  matrix  Z»  induced  by  the  Euclidean 
norm  ll*ll2 

Frobenius  norm  of  matrix  Z  (||Z|[-  =  /  .  /.Iz..l) 

i  j  il 


2.  Block  Kronecker  Products 

This  section  introduces  the  block  Kronecker  product  and  a  related 
vector  valued  function  vecb(*).  The  algebra  associated  with  the  block 
Kronecker  product  is  also  presented  (in  Table  A).  The  reader  familiar  with 
the  standard  Kronecker  algebra  will  quickly  recognize  that  the  block 
Kronecker  algebra  is  almost  identical.  This  is  essentially  due  to  property 
(A. 3)  of  Table  A. 

It  should  be  recognized  that  below  the  primary  consideration  is  the 
special  case  of  square  matrices  with  square  diagonal  blocks.  This 
restriction  is  to  avoid  notational  complexity  and  confusion.  However,  most 
of  the  results  extend  to  more  general  partitions.  The  extensions  . 
require  a  clear  definition  of  how  various  matrices  are  partitioned  (such  as 
when  multiplying  rectangular  matrices  A  and  B) . 


Consider  the  nxn  partitioned  matrices 


A  =  [A.  .]  . .  .  .  x 

ij  U.j  =  1 . r) 


(2.1a) 


B  =  [B .  . ]  , .  .  _  ,  » 

ij  (i»j  =  1. .. .»r) 


(2.1b) 


where  A.,  and  B..  are  n.xn.  and  T^n.  =  n.  The  n^xl  vector  vecb(A)  is 

13  13  13  ^  1 

defined  by 


i=l 


vecb (A)  = 


r 


vec (Ajj) 


vec(A^) 

vec(A12} 


vec (Ar2) 


vec(Alr) 


vec (A  ) 
rr 


(2.2) 


Notice  that  vecb(*)  is  a  linear  operator. 

It  is  desired  to  define  an  operation  A  ®  B  such  that  for  an  nxn  matrix 
D  partitioned  identically  to  A  and  B 


vecb(BDA  )  =  (A  ®  B)vecb (D) . 


(2.3) 


This  motivates  the  definition  of  the  block  Kronecker  product  of  A  and  B, 
-  -  2  2 

denoted  by  A  ®  B.  A  ®  B  is  the  n  xn  matrix  defined  by 


A  ®  B  = 


Au®B 

An®B 


A12®B 

A22®B 


A  ,  ®  B  A  _  ®  B 
rl  r2 


A,  9  B 
lr 

A„  ®  B 
2r 


A  ®  B 
rr 


(2.  A) 


A 


where  the  n^n  x  n^n  matrix  product  ®  B  is  defined  by 


A. .  ®  B  - 


Aij  ®  B11  Aij  ®  B12  *•*  Aij  ®  Blr 
Aij  ®  B21  Aij  ®  B22  *”  Aij  ®  B2r 


A. .  ®  B  ,  A.  .  ®  B  _  ...  A. .  ®  B 

i]  rl  rj  r2  ij  rr 


(2.5) 


The  block  Kronecker  sum  of  A  and  B  is  denoted  by  A  ©  B  and  is  defined  by 


A  ©  B  =  A  ®  I  +  I  ®B. 

n  n 


(2.6) 


Recognize  that  if  the  matrices  A,  B  and  1^  are  partitioned  into  their  scalar 
elements  (i.e.,  r=n)  then  A  ®  B  =  A  ®  B  and  A  ©  B  =  A  ©  B»  such  that  the 
block  Kronecker  product  and  block  Kronecker  sum  reduce  respectively  to  the  ■ 
Kronecker  product  and  Kronecker  sum. 

Some  of  the  basic  algebraic  properties  of  the  block  Kronecker  product 
and  block  Kronecker  sum  are  presented  in  Table  A.  In  this  table  it  is 
assumed  that  A  and  B  are  turn  matrices  partitioned  as  in  (2.1)  and  C  and  D 
are  nxn  matrices  partitioned  identically  to  A  and  B.  Also,  f(*)  denotes  an 

f  •  \ 

analytic  function.  The  eigenvalues  of  A  are  denoted  by  a'1  (i=l . n)  and 

(i) 

a  denotes  the  corresponding  eigenvectors.  Similarly,  the  eigenvalues  of 
B  are  denoted  by  ft  and  fi  ^  denotes  the  corresponding  eigenvectors. 
Recognize  that  if  A  or  B  have  redundant  eigenvalues  then  it  is  possible  to 
have  a"^  =  or  /3^  =  /3^  for  jj£k.  Thus  statements  (A.  15)-(A.17)  in 

Table  A  are  not  redundant. 


To  understand  (A. 17)  it  is  necessary  to  define  the  block  Kronecker 
product  of  two  vectors.  So  consider  the  n  dimensional  partitioned  vectors 


x  = 


.  T  T 

Lxr  x2* 


T1 

...  xrJ 


(2.7a) 


y  = 


r  T  T 

lyv  y2> 


Ti 

•  ••  yrJ 


(2.7b) 


where  z 
x  ®  y  i 


where 


r 

^  and  y^  are  n^  vectors  and  ^  =  n.  Then,  the  n^xl  vector 

i=l 

s  defined  by 


(A.  1) 
(A.  2) 
(A.  3) 
(A.  A) 
(A.5) 
(A.6) 
(A.  7) 
(A.  8) 
(A. 9) 
(A. 10) 
(A. 11) 


x  ®  y  ■ 


*i  ®  yi 


j2 


x.  ®  y 
r  J  r 


x  W  y 


®  y 

*2  ®  y 


*r  ®  y 


(2.8) 


(2.9) 


Table  A 

Algebra  of  Block  Kronecker  Products 

vecb(ADB)  =  (B^  ®  A)vecb(D) 

vecb(AD+DB)  =  (BT  0  A)vecb(D) 

—  T 

A  ®  B  =  P  (A  ®  B)D  for  some  permutation  matrix  P 

(A+B)  ®C=A®C+B®C 

A  ®  (B+C)  =  A®B  +  A®C 

(A  ®  B)T  =  AT  ®  BT 

(A  ®  B)  (C  ®  D)  =  (AC)  ®  (BD) 

(A  ®  B)'1  =  A-1  ®  B_1 

B  ®  A  =  Q(A  ®  B)Q  for  some  permutation  matrix  Q 
det(A®B)  =  [det(A)det(B)]n 
tr(A  x  B)  =  tr(A)tr(B) 
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(A.  12)  f(I  ®  A)  =  I  ®  f (A) 
n  n 

(A.  13)  f(A  ®  I  )  =  f  (A)  ®  I 
n  n 

(A.  14)  exp  (A  ®B)  =  exp  (A)  ®  exp(B) 


(A.  15) 


(A.  16) 


(A.  17) 


_  2 

The  eigenvalues  of  (A  ®  B)  are  the  n  numbers 
(i, j=l,2, ... ,n) 

_  2 

The  eigenvalues  of  (A  ©  B)  are  the  n  numbers 

A(iVj)  (i»j=l»2 . n) 

®  /3^  is  an  eigenvector  of  A®  B  with 
eigenvalue  A^M^  and  is  also  an  eigenvector  of 
A  ®  B  with  eigenvalue  A^/t^  . 


The  proofs  of  most  of  the  properties  presented  in  Table  A  are  easy  once 
the  validity  of  (A. 1)  and  (A.3)  is  established.  Thus  the  proofs  of  these 
two  statements  are  presented  and  then  the  proofs  of  the  remaining  results 
are  discussed  with  the  exception  of  property  (A. 17)  whose  proof  is  presented 
in  detail 

Proof  of  (A. 1).  By  definition 


vec((ADB)11) 


vecb(ADB)  = 


vec((ADB)rl) 
vec ( (ADB) 12) 


vec ( (ADB) r2) 


vec ( (ADB) . 


(2.10) 


vec ((ADB)  ) 
rr 
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The  (p,q)  block  of  (ADB)  is  given  by 


r  r 


(ADB)  =  V  Y*A  .D.  .B.  . 
pq  L-i  PJ  JX  xq 


(2.11) 


i=l  i=l 


Also, 


vec(A  .D..B.  )  =  (B.  ®A  .)vec(D..). 

pj  31  iq  iq  pi  ji 


(2.12) 


Substituting  (2.10)  and  (2.11)  into  (2.9)  shows  that  vecb(ADB)  may  be 
expressed  as  an  rxr  block  matrix  where  the  (p,q)  block  has  dimension 
n  n  x  n  n  and  is  given  by 

p  q  p  q 


E(BT  ®A..)vec(D.  ) 
qp  xi  ia 


tvecb(ADB)] 


pq 


iq 


(B„  ®  A..)vec(D  ) 

^  qP  2j  jq 


£<BQO  9  Ari)vec^Difl^ 

qp  rj  jq 


or  equivalently. 


[vecb(ADB)]  =  (B  ®  A) 

pq  qp 


vec(D,  ) 

iq 

vec  (D.  ) 

2q 


vec (D  ) 

rq 


(A.l)  follows  from  (2.14).  □ 


Proof  of  (A. 3) .  Consider  the  equation 


(2.13) 


(2.14) 


adbt  =  c 


(2.15) 


which  is  equivalent  to 
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(A  ®  B)vec(D)  =vec(C), 


(2.16) 


Applying  (A.l)  to  (2.15)  yields 


(A  ®  B)vecb(D)  =  vecb(C) 


(2.17) 


Now,  there  exists  a  permutation  matrix  P  such  that 


vecb(C)  =  Pvec(C) 


(2.18a) 


vecb(D)  =  Pvec(D). 


(2.18b) 


T  T 

Substituting  (2.18)  into  (2.17),  premultip lying  by  P  and  using  P  P  =  I 

t 

yields 


PT(A  ®  B)Pvec(D)  =  vec(C) . 


(2.19) 


Subtracting  (2.16)  from  (2.19)  yields 


[PT(A  ®  B)P  -  (A  ®  B)lvec(D)  =  0. 


(2.20) 


Since  (2.20)  is  valid  for  all  choices  of  D  it  follows  that  the  expression  in 
[  ]  is  identically  zero.  □ 

(A. 2)  now  follows  from  (A.l).  (A. 3)  implies  that 


A  ®  B  =  P(A  ®  B)P  . 


(2.21) 


The  proofs  of  (A.4)-(A.9)  are  then  obtained  by  substituting  (2.21)  into  the 
equivalent  expressions  for  the  standard  Kronecker  product  and  Kronecker  sum 
[4,8].  For  example,  substituting  (2.21)  into 


(A  ®  B)  (C  ®  D)  =  (AC)  ®  (BD) 


(2.22) 
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yields 


P(A  ®  B)PTP(C  ®  D)PT  =  P(AC)  ®  (BD)PT. 


(2.23 


Pre-  and  post-multiplying  (2.23)  respectively  by  P  and  P  yields  (A. 7). 

The  proofs  of  (A.lO)-(A.ll)  and  (A.  15)-(A.  16)  follow  from  the 
equivalent  results  for  the  Kronecker  product  and  Kronecker  sum  [4.8],  the 
property  (A. 3)  and  the  fact  that  the  determinant,  trace  and  eigenvalues  of  a 
matrix  are  invariant  under  similarity  transformation. 

jg»3Kr»?5=2D 

00 

Since  f(*)  is  analytic,  there  exists  a  scalar  sequence  {fj._0  8UC^ 


f(x)  =  £vn* 


(2.24) 


Also,  from  (A. 7)  it  follows  that 


(I  ®  A)  1  =  I  ®  A1 
n  n 


(2.25a) 


(A  ®  I  ) 1  =  A1  ®  I  . 

Q  Q 


(2.25b) 


The  proofs  of  (A. 12)  and  (A. 13)  follow  from  (2.24)  and  (2.25).  (A. 14)  is  a 

direct  result  of  (A. 12)  and  (A.  13). 


Finally,  the  proof  of  (A. 17)  is  presented. 


Proof  of  (A. 17).  Let  col^(M)  denote  the  first  column  of  the  matrix  M 


and  let  the  nxn  matrices  E  and  F  satisfy 


col1(E)  = 


(2.26a) 


col.  (F)  =  . 


(2.26b) 
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I 


H 


Then, 

col1(AE)  =  (2.27a) 

col1(BF)  =  /3(jVj).  (2.27b) 

Using  (A.  7)  one  may  write 

(A  ®  B)  (E  ®  F)  =  AE  ®  BF  (2.28) 

and  thus 

(A  ®  B)col1(E  ®  F)  =  AE  ®  BF.  (2.29) 

Recognize  that  for  any  nxn  matrices  M  and  N 

col1(M  ®  N)  =  col1(M)  ®  col1(N).  (2.30) 

The  proof  is  completed  by  using  (2.30)  and  substituting  (2.26)  into  (2.27) 
to  obtain 

(A®  B)(a(l)  «  =  A(i)/3 (j)(a(l)  ®  /S(j)).  (2.31) 


3 .  Block  Norm  Matrices 

This  section  defines  the  block  norm  matrix  and  block  comparison  matrix 
of  a  given  matrix.  Then  some  basic  properties  of  the  block  norm  matrix  are 
presented. 

Consider  the  pxq  partitioned  matrix 


.u;  j=l. 


(3.1) 


U  V 

where  is  p^xq^,  =  P  =  1*  ^en  f°r  any  niatrix  norm 

i  i 

I  I • I lg  define  the  urv  block  norm  matrix  Nq  [12]  by 


“.=  sr  ["“ij  I  'e1  (i«i _ p:  i-x . «•’> 


The  nonnegative  matrix  NQ  is  a  generalization  of  the  modulus  matrix 
(Cl N . .11)  for  scalar  partitioned  matrices 


Also,  consider  the  pxp  partitioned  matrix 


M=  [M. .]  ..  .  . 

y  [ i» j_ l » •  •  • » u) 


(3.3) 


where  M.^  is  p^xp ^ .  Let  I  I  •  |  denote  a  matrix  norm  induced  by  the  vector 
norm  1 1 • I and  define  the  uxu  block  comparison  matrix  [12]  by 


Mw  =  [M]rf  $  [m.  .]  . .  .  , 

~P  ~  P  ~xj  U.J=1...., 


u) 


(3.4a) 


where 


s-  -  n«uigl 


(3.4b) 


-ij  =”**Mij**^  for  (3.4c) 

Here  it  is  assumed  that  if  is  singular,  then  NmT^II^1  =  0.  is  a 
generalization  of  the  comparison  matrix  [2]  for  scalar  partitioned  matrices 


Some  of  the  properties  of  block  norm  and  block  comparison  matrices  are 
presented  in  Table  B.  However,  before  discussing  and  proving  these 
properties  we  state  the  following  results  on  matrix  norms. 
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Proposition  3.1.  Let  U  be  an  mxn  matrix  and  V  an  nxp  matrix 

o-.i.w)! m  iE  < 

lloMp^W  i.  IIOTIIy  <  llull^v).  ' 

2 

Proof.  Express  f |UV I ly  as 

I  |UV |  \2  =  trtvVHlV). 
c 

But  has  the  modal  composition 

lAj  =  E*VlE 

where  E  is  unitary  and 

n  =  diagfojoj)}"^. 

Thus, 

|  |UV| \l  =  trCV^^V)  *  trCnEW1^11). 
r 

It  follows  that 

a-2.  CU)tr(EWHE)  <  llUVllJ  <  <r*  (0) tr (EwV) 

mxn  —  r  —  max 

(3.5a)  then  follows  since 

trCEV^E)  =  trCW1*)  =  lIVll*. 

(3.5b)  is  proved  similarly  by  usirg 


I  lUVl  il  =  trdJwW  □ 


Proposition  3.2.  Let  U  and  V  be  arbitrary  matrices.  Then, 


Proof. 


a ■  (U  ®  V)  =  cr  (U)o-  (V). 

max  max  max 


<T2  (U  ®  V)  =  X  ( (U  ®  V)  (U  ®  v)H) . 
max  max 


(3.13) 


(3.14) 


Using  known  properties  of  the  Kronecker  product  [4,8]  it  follows  that 


(U  ®  V) 

max 


=  x  (uu11  ®  W1*) 


max 


=  X  (UU^X  (W11) 

max  max 


=  cr2  vU )<r2  iV).D 
max  max 


Proposition  3.3.  Let  U  be  an  arbitrary  matrix.  Then, 


(3.15) 


||vec(U)||F  =  IIU|IF. 


(3.16) 


Proof.  The  result  follows  from  the  definition  of  the  Frobenius  norm  | |* |  Ip.  CD 


In  Table  B,  c  denotes  a  scalar,  M  is  a  pxp  matrix  partitioned  as  in 
(3.3),  N  and  R  are  pxq  matrices  partitioned  as  in  (3.1)  and  P  is  an  sxp 
matrix  partitioned  compatibly  with  M  and  N.  A,  B  and  D  are  nxn  matrices 
partitioned  identically  in  the  form  (2.1).  The  partitions  of  vecb(D)  are 
assumed  to  be  the  vectors  vec(D„)  and  the  partitions  of  (A  ®  B)  ape  chosen 
compatibly  (i.e.  the  partitions  are  all  of  the  form  A^. 


« 
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Table  B 

Block  Norm  Matrix  Properties 


(B.l) 

tCNle  =  |C|N0 

(B.2) 

tiwl]e  <<  Ne  .  R0 

(B.3) 

(B.4) 

n  5  A 

(B.5) 

tfS]F  n  pfs8 

(B.6) 

[fmlF  >> 

(B.7) 

•  [A  ®  B]  s  =  Ag  ®  Bfi 

(B.8) 

[A  ©  B]  <<  A  9  B 
s  —  s  s 

(B.9) 

[vecMD)]^  =  vec(DF) 

(B.l)  and  (B.2)  follow  immediately  from  the  norm  properties 
I (cNl !0  =  | c (  I |N| |Q  and  the  triangle  inequality, 

| |N+R| 1^  _<  | |N| |0  +  | I R | |Q,  (B.3)  is  a  result  of  the  triangle  inequality 

and  the  induced  norm  property  | |PN| |^  £  HPlI^llNlI^. 

Before  considering  the  remaining  results,  recognize  that 


<J  (N. .)  =  |  |N. .  1 1 
max  xj  ij  s 


cr  .  (M.J  =  IlM^ir1. 
mxn  xx  xx  s 


(3.17a) 

(3.17b) 


(B.4)  and  (B.5)  then  follow  respectively  from  the  triangle  inequality  and 
the  right  hand  side  inequalities  of  (3.5a)  and  (3.5b). 


r 


Proof  of  (B.6). 


u 


1 1 CMN) . . 1 1_ 
e 


k=l 

k*i 


(3.18) 


It  then  follows  from  ||N+R||  >  | |N| |  -  ||R||  and  (3.5a)  that 


||(MN)  ||  >  cr  (M  )||N  || 

ij  r  min  11  ij  r 


1 1  IXaj  i  >r 

k=l 

k*i 


But  since 


k=l 

k^i 


k=l 

k*i 


(3.19) 


(3.20) 


it  follows  that 


ll(KM)«llF^.i»(MU)IINijllF*  X>  ""tt"F)"V, 

k=l 

k/i 


which  is  equivalent  to 


II (MO y I lf  >  X/Vik'Vkj- 

k=l 


(B.6)  follows  from  (3.22).  □ 


Proof  of  (B.7). 


(A  ®  B)  =  [A.  .  ®  B]  .  . 

w  rj  ( i,  J  =  1 , . . . , 


(3.21) 


(3.22) 


(3.23) 
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I  f 


I . 


I  i 


I 


where 


A.  .  ®  B 
3-3 


It  follows  that 


A. . 
3-3 

®B11 

A.  . 
3-3 

®B12 

A.  . 
3-3 

®Blr 

A.. 

3-3 

®B21 

* 

A.  . 
3-3 

®  B22 

•  • 

A.  . 
3-3 

®B2r 

• 

A. . 
3-3 

• 

®Brl 

A.  . 
3-3 

•  • 

•  • 

®  Br2 

A.  . 
3-3 

• 

• 

®  B 

rr 

(*®B)s  .  [(A..  . r) 

Using  (3.13),  write 

Substituting  (3.26)  into  (3.24)  yields 


[A.  .  ®  B]  =  [A  ]  .  .B  . 
3-3  s  s  ij  s 


(3.24) 


(3.25) 


(3.26) 


(3.27) 


(B.7)  follows  from  (3.25)  and  (3.27).  □ 

(B.8)  now  follows  from  (B.2)  and  (B.7).  (B.9)  is  a  result  of  (3.16) 


4.  Diagonal  Structures 

In  this  section  results  concerning  block-diagonal  and  diagonal  matrices 
are  presented.  These  results  are  used  in  the  example  of  the  next  section. 

Assume  that  A  and  B  are  nxn  matrices  of  the  form 


A  =  block-diag{A.} v.  , 
1  1=1 


(4.1a) 
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B  =  block -diag {B . 

i  i=l 


(4 


where  A.  and  B.  are  n.xn.  and  /  ,n.  =  n. 

l  l  ii  i 

i=l 


2  2 

Then  A  ®  B  is  the  n  xn  matrix 


A®  B  =  block-diag{C.}7  , 

l  i=l 


(4 


where  is  the  n^n  x  n^n  block-diagonal  matrix. 


C.  = 

i 


Ai®Bi 


Ai®B2 


A.  ®  B 
i  r 


(4 


Thus  A  ®  B  is  block-diagonal  with  diagonal  subblocks  of  the  form  A^  ®  B^ 


2  2 

It  follows  that  A  ®  B  is  the  n  xn  matrix 


A  ©  B  =  block -diag (D J T=1 


(4, 


where  is  the  n^n  x  n^n  block  diagonal  matrix. 


D.  = 

l 


Ai©Bl 


A.  ©B2 


A.  ©  B 
l  r 


(4, 


Thus  A  ©  B  is  block -diagonal  with  diagonal  subblocks  of  the  form  A „  ©  B . , 

'  i  3 


2  2  2 

Now  suppose  v  is  an  r  vector  and  E  is  an  r  xr  diagonal  matrix. 


Express  E  as 


E  =  block-diag{E.}T  , 

l  i=l 


(4. 


where  the  rxr  diagonal  matrix  E.  is  given  by 


(4.4b) 


E .  =  diag {e . . }  . 
i  it 


Then 


vec  ^(Ev)  =  E*vec  ^(v), 


where  denotes  the  Hadamard  product  and 


E  =  [e. .]  , .  .  .  . 

ij  (i.j=l... ..r) 


(4.5) 


(4.6) 


5.  An  Illustrative  ExaaP.l& 

We  now  use  results  from  Sections  2,  3  and  4  to  derive  the  covariance 
block  norm  inequality  found  in  [7,  Proposition  4.2], 

Consider  the  nth  order  system 

x(t)  =  (A+G)x(t)  +  w(t)  (5.1) 

where  w(t)  is  white  noise  with  intensity  V.  It  is  assumed  that  the  nxn 
matrix  A  is  a  stability  matrix  of  the  form 

A  =  block-diag{A^} (5.2) 


r 

where  A^  is  n^xn^  ( ^  \i  .=n)  and  represents  the  dynamics  of  the  ith 

1 

subsystem.  G  is  an  nxn  matrix  partitioned  compatibly  with  A.  The  off- 
diagonal  blocks  of  G  represent  the  uncertain  interactions  among  the 

A 

various  subsystems.  It  is  assumed  that  for  some  nonnegative  rxr  matrix  G, 

G  <<  G.  (5.3) 

s  — 

Notice  that  G  is  a  matrix  majorant  of  G  [5] . 
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Assuming  (A+G)  is  a  stability  matrix,  the  asymptotic  state  covariance  Q 
satisfies  the  Lyapunov  equation, 

0  =  (A+G)Q  +  Q(A+G)T  +  V.  (5.4) 

Assume  that  all  matrices  in  (5.4)  are  partitioned  compatibly.  Then 
operating  on  (5.4)  with  vecb(-)  and  using  (A. 2)  yields 

-(A  ©  A)vecb(Q)  =  (G  ©  G)vecb(Q)  +vecb(V).  (5.5) 


and  thus 


[-(A  ©  A)vecb(Q)]F  =  [ (G  ffi  G)vecb(Q)  +  vecb(V)]F.  (5.6) 

Considering  the  right  hand  side  of  (5.6)  and  using  (B.2),  (B.4),  (B.8), 
(B.9)  and  (5.3)  consecutively,  yields 

[  (G  ©  G)vecb(Q)  +  vecb(V)]F 

'  <<  [(G  ©  G)vecb(Q)]F  +  [vecb(V)]F 

<<  [G  ©  G]  s  [vecb(Q)]  F  +  [vecb(V)lF 

<<  (G  ©G  )  vecb(Q_)  +  vec(V_) 

—  s  s  t  c 

<<  (G  ©  G)  vec(QF)  +vec(VF).  (5.7) 

Similarly,  considering  the  left  hand  side  of  (5.6)  and  using  (B.l),  (B.6) 
and  (B.9)  yields 

(-(A  ©  A)vecb(Q)]  >>  (A  ©  A)  vecb(Qw).  (5.8) 

Thus,  from  (5.6)-(5.8) 
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(5.9) 


(A  +  A)^vec(Qp)  <£  (G  +  G)vec(QF)  +  vec(V^). 

-  2  2 

It  follows  from  (4.3)  that  (A  ®  A)  is  the  r  xr  diagonal  matrix 


(A  ®  A)  =  block -diag{ [D.]  }T  . 

s  —i  s  1=1 


(5.10a) 


where  [0.]  is  the  rxr  diagonal  matrix 

"“1  S 


[D  ]  =  diag{cr  .  (A.  ©A.)}T  .. 

—is  min  i  j  j=l 


(5.10b) 


Define  the  nxn  matrix  A  by 


A  =  [<r  .  (A.  ©  A.)]  , .  .  ,  .  . 

min  i  2  ..r) 


(5.11) 


Then  using  (5.10)  and  (4.5)  and  operating  with  vec  (•)  on  both  sides  of 
(5.9)  yields 


a*Qf  11  gqf  *  QfgT  ♦  VF 


(5.12) 


which  is  the  covariance  block  norm  inequality  of  [7,  Proposition  4.2], 
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Abstract 


This  work  considers  uncertain  multi-input  multi-output  sysems  described  in  the  frequency 
domain.  The  theory  of  nonnegative  matrices  and  M-matrices  is  used  along  with  majorant  bound¬ 
ing  techniques  to  develop  robust  stability  and  performance  results  for  two  types  of  uncertainty. 
The  first  type  is  uncertainty  with  norm  bounded  subblocks  (i.e.,  ||Qo(.7w)||s  <  The 

second  type  is  uncertainty  that  has  subblocks  with  known  patterns  but  unknown  gains  (i.e., 
Qijiju)  €  {Pij[jw)Wij(ju>)  :|  |<  qij(ju))}) .  For  uncertainties  of  this  type  a  recursive 

analysis  methodology  is  developed  which  yields  increasingly  nonconservative  results.  Throughout 
this  paper  performance  is  measured  in  terms  of  the  deviations  of  the  outputs  from  their  nominal 
values.  The  results  are  illustrated  by  a  numerical  exampK  . 


1.  Introduction 


A  central  problem  in  feedback  control  is  to  achieve  acceptable  performance  in  the  presence 
of  uncertain  plant  dynamics  and  disturbances.  This  necessitates  the  development  of  analysis  tools 
capable  of  determining  the  behavior  of  a  given  feedback  system  in  the  presence  of  uncertainty.  Thus, 
over  the  past  decade  considerable  attention  has  been  given  to  the  issue  of  robustness  analysis. 

In  the  frequency  domain  setting  initial  attention  was  given  to  unstructured  uncertainty,  that  is, 
norm  bounded  uncertainty.  This  focus  led  to  the  development  of  singular  value  analysis  [1-5]  which 
is  particularly  useful  for  systems  with  unmodeled  high  frequency  dynamics.  However,  when  the 
uncertainty  has  structure,  it  is  well  known  that  singular  value  analysis  can  yield  very  conservative 
results. 

This  conservatism  has  led  to  the  investigation  of  analysis  tools  applicable  to  systems  with 
uncertainty  which  is  more  structured.  References  [6-18]  present  analysis  methodologies  for  a  variety 
of  forms  of  structured  uncertainty.  These  methodologies  generally  depend  upon  one  or  more  of  the 
following  tools: 

(i)  non-X2  (i  e.,  Lx  or  L^)  matrix  norms  [7,10] 

(ii)  weighted  matrix  norms  or  system  transformation  [6,7,10,14-16] 

(iii)  the  theory  of  nonnegative  and  M-matrices  [7,8,10-13] 

(iv)  mapping  theorems  [17,18] 

A  common  feature  of  many  of  the  robustness  results  to  date  is  that  they  consider  only  the 
qualitative  issue  of  stability.  However,  in  practice  one  is  also  concerned  with  the  quantitative 
issue  of  performance  where  performance  is  measured  in  terms  of  the  effect  of  certain  signals  or 
disturbances  on  specified  system  variables.  Robustness  results  which  do  address  the  performance 
problem  are  found  in  [15,26-29]. 

This  paper  uses  the  theory  of  nonnegative  matrices  and  M-matrices  along  with  majorant  bound¬ 
ing  techniques  [24,33]  to  develop  robust  stability  and  performance  results  for  two  types  of  uncer¬ 
tainty.  The  first  type  is  block-structured  uncertainty  and  consists  of  uncertainty  with  norm  bounded 
blocks  (  i.e.,  ||<?o(iw)||s  <  9o'0'w))-  The  second  type  is  patterned  block-structured  uncertainty . 
Uncertainty  sets  of  this  type  have  some  blocks  with  known  patterns  but  unknown  gains  (i.e., 
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The  paper  is  organized  as  follows.  Section  2  presents  notation  and  mathematical  preliminaries. 
Section  3  states  and  formulates  the  general  problem  under  consideration.  Section  4  then  presents 
robustness  results  for  systems  with  structured  uncertainty.  It  is  shown  that  the  robust  stability 
results  are  nonconservative  if  the  nominal  transfer  matrix  P(s)  is  block-diagonal.  Next,  Section 
5  considers  systems  with  highly  structured  uncertainty  and  develops  a  recursive  methodology  to 
obtain  increasingly  nonconservative  robustness  results.  Section  6  presents  an  illustrative  example. 
Finally,  Section  7  summarizes  and  discusses  the  main  results. 


2.  Notation  and  Preliminaries 


In  the  following  notation  the  matrices  and  vectors  are  in  general  assumed  to  be  complex. 


IR  (IR+) 

C  (C+) 

'p 

if" 

zij 

Z*J 

block-diag  (Zl}. .  .,ZM) 


set  of  (nonnegative)  real  numbers 
(closed  right  half)  complex  plane 
pxp  identity  matrix 
complex  conjugate  transpose  of  matrix  Z 
(t,j)  element  of  matrix  Z 

( i,j )  matrix  block  of  partitioned  matrix  Z  or  (i,j)  element  of  Z 
block-diagonal  matrix  with  listed  diagonal  blocks 


Y  <<  Z 

nonnegative  matrix 

M 

p{z) 

det(Z) 

ll*lla 

»m.  x(Z) 

\\z\\s 

gn  x  n 

!!5lloo 


llii  <  for  each  «  and  j 

matrix  with  nonnegative  elements  (Z  >>  0  or  equivalently 
Z  €  IR”xn  for  some  m  and  n) 
absolute  value  of  scalar  a 

spectral  radius  of  square  matrix  Z  (if  Z  >>  0,  p(Z)  is  the  Perron 

root  of  Z  [31,32].) 

determinant  of  square  matrix  Z 

Euclidean  norm  of  vector  x  (  =  V xHx ) 

largest  singular  value  of  matrix  Z 

spectral  norm  of  matrix  Z  (  =  a max(Z)),  subordinate  to  the 
Euclidean  norm 

the  space  of  all  rational  n-vector  functions  bounded  on  the  ju- axis 
(i.e.,  ||v(jw)||2  <  oo  for  all  w). 

the  space  of  all  rational,  stable  and  proper  n  x  n  transfer-function  matrices 
Hoo  norm  of  S(s)  6  S"xn(  =  supw  <rmmx[S(jw)]) 
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Let  A,  B  £  <DnXO  and  i  £  <Dn  have  the  partitioned  forms 

A  =  [•Aij](»,j  =  l r) 

■S  =  [^»y](*,y=x r) 

XT  =  [xT,...,X?) 


(2.1) 

(2.2) 

(2.3) 


where  Aij,Bij  £  <nn,Xn>,Zj  £  <Dn<  and  =  n.  The  block  norm  matrix  [20,31]  of  A  is  the  r  x  r 

1=1 

nonnegative  matrix 

3  =  [IUM*],*., . .  (24) 

Similarly,  the  block  norm  vector  of  x  is  the  nonnegative  vector  z  G  IRr  defined  by 


_T  A 
*  — 


=  [IM . .IN-IW- 


(2.5) 


For  convenience  block  norm  matrices  and  vectors  will  be  referred  to  simply  as  “block  norms”. 
Subsequent  analysis  will  use  the  following  block  norm  relations  [33]. 


(aA)  —  a  A,  a  £  IR 


(A +  5)  <<  A  +  B 
( AB )  <<AB 
{Ax)  <<  Ax. 


(2.6) 

(2.7) 

(2.8) 

(2.9) 


Majorants  [22]  are  essentially  element-by-element  upper  bounds  for  block  norms.  Precisely, 
nonnegative  A  £  IRrXr  and  x  £  IRr  are  majorants  respectively  of  A  and  x  if 


A  <<  A 

x  <<  x. 


(2.10) 

(2.11) 


A  matrix  F  £  rRpXp  is  an  M-matrix  [28-30]  if  it  has  nonpositive  off-diagonal  elements  [i.e., 
Pij  <  0  for  »  j]  and  positive  principal  minors.  There  are  many  equivalent  characterizations  of 
M-matrices  [28-30].  A  particularly  useful  one  for  the  analysis  of  this  paper  is  that  F  is  an  M-matrix 
if  and  only  if  it  has  nonpositive  off-  diagonal  elements  and  a  nonnegative  inverse  (i.e.,  F-1  >>  0). 
Also,  if  D  £  IR”xm,  then  Im  -  D  is  an  M-  matrix  if  and  only  if  p{D)  <  1. 
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Annxn  rational  transfer-function  matrix  H(s)  is  stable  if  it  has  no  poles  in  the  closed  right 
hand  plane  (i.e.,  it  is  analytic).  A  linear  time  invariant  system  with  input  v,  output  y  and  transfer 
representation 

y(s)  =  H{s)v(s)  (2.12) 

is  stable  if  H(s )  is  rational,  stable  and  proper  (i.e.,  H[s)  £  SnXn).  This  definition  of  system 
stability  is  equivalent  to  bounded-input  bounded-output  stability. 

The  Foo-norm  of  S(s)  £  Sr*Xn(j|5||00)  generates  a  topology  in  SnXn.  Given  any  set  H  C  SnXn 
it  is  possible  to  define  a  relative  topology  in  H  [5].  The  set  H  is  arcwise  connected  if  given 
any  two  elements  Hq(s)  and  if\(s )  in  H,  there  exists  a  continuous  map  M  :  [0,1]  — +  H,  such 
that  M(0)  =  H0(s)  and  Af(l)  =  ffi(s).  In  more  physical  terms,  if  H  is  arcwise  connected  then 
it  is  possible  to  perturb  the  system  from  Ho  to  Hi  continuously  without  abrupt  changes  in  the 
properties  of  the  plant.  For  example,  if  Ho  has  a  open  right  half  plane  zero  and  Hi  has  a  open 
left  half  plane  zero  then  Ho  can  be  perturbed  continously  to  Hi  only  by  having  a  zero  cross  the 
imaginary  axis.  That  is,  for  any  continuous  map  At(-)  having  the  properties  described  above,  there 
exists  a  p  £  (0, 1)  such  that  H'[s)  =  -M(p)  has  a  zero  on  the  imaginary  axis.  The  reader  is  referred 
to  [5,16]  for  further  discussion  of  these  results. 

3.  Problem  Statement  and  Formulation 
Consider  the  linear  time  invariant  systems 

y(5)  =  —P(s)Q{s)y(s)  +  R(s)v{s )  (3.1) 

y(s)  =  -Q(s)P(s)y(s)  +  f?(s)u(s).  (3.1)' 

The  input  v  and  output  y  are  in  Cn  and  have  the  partitioned  forms 


II 

T4 

T 

yr  =  [yi\- 

T 

•  >yr 

where  v^.y^  £  <Cn''  and  =  n.  The  transfer-function  matrices  P,Q  and  R  are  partitioned 


conformably  with  v  and  y  such  that 


3, 


I 


I 


I 


Q  =  [QaUij=i . r)  (3.5) 

R  =  [-R,y](.,y=i _ r)  (3.6) 

where  Pij,Qij,  Rij  G  Cn<Xny.  It  is  assumed  that  P(s)  is  a  known  matrix  while  Q(s)  and  i?(s)  are 
members  of  the  given  uncertainty  sets  Q  and  R.  That  is, 

Q(s)  G  Q  (3.7) 

R{s )  €  R.  (3.8) 

Definition  3.1.  A  system  (3.1)  or  (3.1')  is  said  to  be  robustly  stable  if  it  is  stable  for  each 
Q{s)  G  Q  and  R(s )  €  R. 

Many  uncertain  systems  can  be  represented  in  the  form  (3.1)  or  (3.1').  For  example,  consider 
the  decentralized  control  configuration  of  Figure  3.1  where  A(s)  is  an  additive  uncertainty  repre¬ 
senting  uncertain  subsystem  interconnections.  The  relationship  between  y  and  v  can  be  expressed 
as 

[/»  +  (G(s)  +  A(a))JT(a)]y(a)  =  [G(a)  +  A(s)]  K{s)v(s).  (3.9) 

Now,  (omitting  the  argument  s  for  convenience)  the  return  difference  matrix  can  be  factored  as 

[in  +  (G  +  A)  if]  =  [l  +  AK(In  +  GK)-l][In  +  GK].  (3.10) 

Substituting  (3.10)  into  (3.9)  and  letting 


y(«)  =  [In  +  G(s)A(s)]y(s) 

(3.11) 

yields 

[/„  +  C?(s)P(s)]y(s)  =  R{s)v(s) 

(3.12) 

where 

Q(s)  =  A  (s) 

(3.13) 

P(s)  =  K(s)[ln  +  G(s)K(s)]-1 

(3.14) 

R(s)=[G(s)  +  Q(s)]K(s). 

(3.15) 

Notice  that  equation  (3.12)  is  identical  to  (3.1').  Also,  notice  that  P(s)  is  block-diagonal.  This 
motivates  the  specialization  of  the  robust  stability  result  of  Theorem  4.1  (given  in  the  next  section) 
to  the  case  in  which  P(s )  is  block-diagonal. 
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An  example  of  a  system  which  is  representable  by  (3.1)  is  the  block-diagonal  perturbation 
configuration  [7,14-15,18]  of  Figure  3.2  which  motivated  Doyle  to  develop  the  structured  singular 
value  [14].  This  configuration  corresponds  to  choosing 


PM  =  mm 

(3.16) 

QM  =  AM 

(3.17) 

RM  =  PM 

(3  18) 

in  (3.1). 

In  what  follows  only  the  system  (3.1)  is  considered.  However,  all  results  are  applicable  to  the 
system  (3.1;)  by  making  trivial  modifications. 

Subsequent  analysis  also  assumes  that  the  input  v  in  (3.1)  is  known  and  bounded  on  the 
imaginary  axis  (i.e.,  v(s)  £  L^).  It  is  desired  to  obtain  sufficient  (or  necessary  and  sufficient) 
conditions  for  robust  stability  and  to  obtain  bounds  on  the  performance  degradation  due  to  the 
uncertainty.  Performance  here  is  measured  in  terms  of  the  magnitude  of  the  deviation  of  the  vector 
partitions  of  y(j'w)  from  their  nominal  values  (i.e.,  the  values  of  the  y<(jv)  for  Q(s)  =  Q°(s)  £  Q 
and  R(s)  =  R°(s)  £  R).  This  criterion  allows  us  to  look  at  performance  degradation  as  a  function 
of  frequency.  The  choice  of  the  nominal  transfer-function  matrices  Q°{s)  and  R°[s)  is  elaborated 
in  subsequent  discussion. 

Below,  it  is  also  assumed  that  P(s)  and  each  R(s)  £  R  are  rational,  proper  and  stable  (i.e., 
P[s )  £  S"Xn  and  R  C  Snxn).  In  addition  it  is  assumed  that  the  uncertainty  set  Q  is  a  set  ofnxn 
transfer-function  matrices  with  (at  least)  the  following  four  properties. 

PI.  QcSnX". 

P2.  Q  is  arcwise  connected. 

P3.  0€Q. 

P4.  There  exists  nonzero  Q(s)  £  Q  such  that  P(s)Q(s)  is  nonconstant  and 
det  [/„  -|-  P(s)<2(s)]  0  for  all  s  £  C+. 

An  example  of  an  uncertainty  set  satisfying  properties  P1-P4  is  the  set  of  transfer-function  ma¬ 
trices  in  Snxn  whose  matrix  blocks  have  norms  which  satisfy  fixed  bounds  on  the  jw-axis,  (i.e., 
||<5,j(jw)||s  <  4*j(ju))-  This  case  is  considered  in  Section  4. 


Since  P(a),Q(s)  and  R(s)  are  each  assumed  to  be  proper  and  stable,  it  follows  that  the  system 
(3.1)  is  stable  if  and  only  if 

det  [/„  +  P(s)<5(s)]  #  0  for  all  s  €  ©  +  .  (3.19) 

The  nominal  transfer  matrix  <2°(s)  is  now  chosen  as 

Q°(s)  =  0.  (3.20) 

It  is  not  necessary  to  specify  the  nominal  transfer  matrix  R°{s).  However,  in  practice  it  will 
generally  be  chosen  to  be  compatible  with  <2°(s).  For  example,  if  R(s)  is  given  by  (3.15),  then  one 
would  choose 

R°(s)  =  G(s)K{s).  (3.21) 

Likewise,  if  f?(s)  is  given  by  (3.18),  then  one  would  choose 

R°(s)  =  P{s).  (3.22) 

Let  y°  denote  the  output  corresponding  to  the  system  (3.1)  with  Q(s)  =  Q°{s)  =  0  and 
R(s)  =  R°(s).  Then, 

y  °(s)  =  f2°(s)v(s).  (3.23) 

Let  e  denote  the  deviation  of  the  output  from  its  nominal  value,  i.e., 

e(s)  =  y(s)  -  y°(s).  (3.24) 

Then,  subtracting  (3.23)  from  (3.1)  shows  that  e(s)  satisfies 

[7„  +  P(s)Q(s)]e(s)  =  z(s)  (3.25) 

where 

x(s)  ±  -P(s)Q{s)R°(S)v(s)  +  [P(s)  -  P0(s)]v(s).  (3.26) 

The  input  x  has  the  partitioned  form 

zT  =  [xj,...,xj)  (3.27) 


where  z<  €  Cn<. 


Definition  3.2.  A  nonnegative  r-vector  c(ju>)  function  is  said  to  be  a  performance  bound  of  a 
system  (3.1)  if  for  each  Q(s)  E  Q  and  R(s)  E  R, 

e(ju>)  <<  c(ju>)  for  all  u>.  (3.28) 

The  objective  of  the  robust  performance  analysis  is  to  find  a  nonconservative  performance  bound 

The  following  theorem  shows  that  system  stability  can  be  determined  from  behavior  on  the  ju- 
axis.  The  corollary  to  this  theorem  relates  the  objectives  of  the  stability  analysis  and  performance 
analysis  by  showing  that  the  system  (3.1)  is  stable  if  and  only  if  e(jui)  is  bounded. 

Theorem  3.1.  The  system  (3.1)  is  robustly  stable  if  and  only  if  for  each  Q(s)  G  Q 

det  [Jn  +  P(ju)Q{j'jj)]  5*  0  for  all  w.  (3.29) 

Proof.  Define 

H  ^  {[/„  +  P(s)Q(*)]  :  Q(s)  E  Q}.  (3.30) 

Since  for  each  Q(s)  €  Q,  P(s)Q(s)  is  stable  and  proper,  each  H(s)  €  H  is  also  stable  and  proper 
(i.e.,  H  C  S”xn).  Also,  the  arcwise  connectedness  of  Q  implies  that  H  is  also  arcwise  connected. 
Using  the  stability  characterization  (3.19)  it  follows  that  the  system  (3.1)  is  stable  for  each  Q[s)  E  Q 
and  R{s)  €  R  if  and  only  if  for  each  JS’(s)  E  H 

det[#(s)]^0  for  all  a  G  <D+  (3.31) 

or  equivalently,  H(s)  does  not  have  any  left  half  plane  zeros.  Now  assume  that  (3.29)  is  satisfied 
and  there  exists  an  Ho(s)  E  H  that  has  a  closed  right  half  plane  zero.  The  proof  proceeds  by 
showing  that  this  is  a  contradiction  and  thus  (3.29)  and  (3.31)  are  equivalent. 

From  property  P4  of  the  set  Q,  it  follows  that  there  exists  an  H"{s )  €  H  that  has  a  zero  in 
the  open  left  hand  plane.  However,  since  H  is  arcwise  connected  there  exists  an  H'{s)  E  H  that 
has  a  zero  on  the  imaginary  axis  which  (since  H'(s)  has  no  poles  on  the  imaginary  axis)  implies 
there  exists  Q'(s)  E  Q  and  u/  E  IR  such  that 

det  [7n  +  P(ju')Q'(ju')]  =  0.  (3.32) 


This  contradicts  (3.29)  and  thus  the  theorem  is  proved.  □ 


Since  P(s),Q(s),  R(s)  and  R°{s)  are  stable  and  proper  transfer  matrices  or  constant  matrices, 
they  are  bounded  on  the  jw-axis.  Thus,  x(s )  defined  by  (3.26)  is  also  bounded  on  the  ju>- axis.  The 
next  corollary  results  from  this  property  of  x (s). 

Corollary  3.1.  The  system  (3.1)  is  robustly  stable  if  any  only  if  there  exists  a  nonnegative 
n-vector  function  e[ju)  such  that  for  each  Q{s)  6  Q  and  R(s)  €  R, 

e(ju)  <<  e(jw)  for  all  w.  (3.33) 

Proof.  Since  x(juj)  is  bounded  for  all  w  (3.25)  indicates  that  (3.29)  is  satisfied  if  and  only  if 
e(ju)  is  bounded  for  all  w.  □ 

As  mentioned  previously,  the  objectives  are  not  only  to  determine  conditions  for  robust  stability 
but  also  to  determine  e  satisfying  (3.33).  In  the  next  section  this  problem  is  considered  for  a 
particular  uncertainty  set  Q. 

4.  Uncertainty  with  Norm  Bounded  Blocks 

This  section  considers  the  case  in  which  the  uncertainty  set  Q  is  given  by  Q'  where 

Q'  ±  {<?(«)  €  Snxn  :Q(ju)  <<  Q(ju)}  (4-1) 

for  some  nonnegative  r  x  r  transfer-function  matrix  Q(/w).  The  block-structured  uncertainty  set  Q7 
satisfies  properties  P1-P4  of  Section  3  and  thus  the  results  of  the  previous  section  apply.  In  fact, 
it  should  be  noted  that  Q7  is  not  only  arcwise  connected  but  is  also  convex  (which  is  a  stronger 
condition).  This  fact  is  used  to  facilitate  the  proof  of  Theorem  4.1. 

Theorem  4.1,  the  main  result  of  this  section,  is  a  multiloop  small  gain  theorem  and  presents 
a  sufficient  condition  for  robust  stability  and  a  performance  bound  e.  This  result  is  essentially  a 
frequency  domain  version  of  earlier  results  by  Porter,  Michel  and  Lasley  [18,19].  If  the  nominal 
matrix  P(s)  is  block-diagonal,  the  first  corollary  shows  that  the  robust  stability  condition  of  Theo¬ 
rem  4.1  is  actually  nonconservative  (i.e.,  necessary  and  sufficient).  The  results  are  also  interpreted 
in  the  context  of  systems  with  block-diagonal  uncertainty  matrices  Q(s)  and  are  shown  to  yield  an 
upper  bound  for  the  structured  singular  value. 

Theorem  4.1.  Suppose  Q  =  Q7.  Then,  if 

p[P(jw)Q(jc;)]  <  1  for  all  w,  (4.2) 
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the  system  (3.1)  is  robustly  stable.  In  this  case  a  performance  bound  is  given  by  Hju)  where 

=  \jr  ~  P(iw)<5(yw)]-1i(j'w)  (4.3) 

and  x(ju )  satisfies 

x(jw)  <<  i(jfw).  (4.4) 

Proof.  See  Appendix  A.  □ 

Now,  consider  the  case  in  which  P(s)  is  block-diagonal  (i.e.,  Pij(s)  =  0  for  t  ^  j).  This 
restriction  on  P(s)  can  correspond  to  situations  in  which  an  interconnected  system  has  well  known 
subsystem  dynamics  and  uncertain  interconnections.  An  example  of  this  is  the  decentralized  control 
configuration  of  Figure  3.1.  The  following  corollary  shows  that  the  robust  stability  condition  of 
Theorem  4.1  is  actually  a  necessary  and  sufficient  condition  when  P(s)  is  block-diagonal. 

Corollary  4.1.  Assume  that  P(s)  is  block-diagonal.  Then  the  system  (3.1)  is  robustly  stable 
for  Q  =  Q'  if  and  only  if  (4.2)  is  satisfied. 

Proof.  See  Appendix  B.  □ 

The  next  corollary  considers  the  case  in  which  Q[ju>)  in  (4.1)  is  given  by 

Q{jw)  =  a{ju)Ir  (4.5) 

where 

ct{ju)  >  0  for  all  u.  (4.6) 

The  problem  of  robust  stability  in  this  case  is  the  block-diagonal  perturbation  problem  considered 
in  [7,14,15,18]  which  motivated  the  develoment  of  the  structured  singular  value. 

Corollary  4.2.  Assume  that  Q  in  (4.1)  is  given  by  (4.5).  Then,  if 

P[PW\  <  for  all  w,  (4.7) 

the  system  (3.1)  is  robustly  stable. 

Proof.  The  proof  follows  by  substituting  (4.6)  into  (4.2).  □ 

Remark  4.1.  Recognize  that  the  performance  bound  (4.4)  remains  valid  under  the  assumptions 
of  Corollaries  4.1  and  4.2. 
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Now  recall  that  under  the  assumption  of  Corollary  4.2,  the  “small  p  theorem”  [15]  states  that 
the  system  (3.1)  is  robustly  stable  if  and  only  if 

fi[P(ju)]  <  /.--r  for  all  u >  (4.8) 

1  1  a(jw) 

where  /i(-)  denotes  the  structured  singular  value  [14,15]. 

An  immediate  consequence  of  the  above  discussion  is  then  the  following  corollary. 

Corollary  4.3.  For  u>o  €  HI 

/x[P(iwo)]  <  p[P{jua)\.  (4.9) 

Remark  4.2.  If  r  =  2  and  «i  =  02  =  1,  then  as  mentioned  in  [17]  it  can  be  shown  that 

H  [P(jwo)]  =  p[P(jojQ)}  ■  (4.10) 


Remark  4.3.  An  alternative  proof  of  Corollary  4.3  is  also  available  [25].  This  proof  is  based 
on  the  characterization  of  /i(-)  found  in  Theorem  1  of  [14].  The  proof  then  follows  by  using  the 
inequality 

p{PUu 0))  <  />[P(iw 0)]  (4.11) 

which  is  presented  in  Theorem  4  of  [20].  (A  simpler  proof  of  (4.11)  is  presented  in  the  Appendix 
of  [20].) 

5.  A  Recursive  Refinement  of  Robustness  Results  for  Highly  Structured  Uncertainty 

This  section  considers  the  robust  stability  of  the  system  (3.1)  for  an  uncertainty  set  Q"  which 
is  more  structured  than  the  uncertainty  set  Q;  of  Section  4.  Further  discussion  requires  the  intro¬ 
duction  of  some  additional  notation  and  definitions. 


Let  m  be  some  set  of  integer  pairs 


m  C  {( ij )  :  1  <  i  <  r,  i  <j  <  r}. 


(5.1) 


For  each  (i,j)  G  m  let  Wij(ju)  be  an  n,  x  ny  transfer-function  matrix.  Also,  for  some  r  x  r 
nonnegative  transfer-function  matrix  Q(jw)  let 

Q"  =  {Q(<s)  e  Q'  :  for  all  u  and  (i,j)  E  m, 

Qi}(j“)  =  I  !<  qiAju)l\\wn\\»}- 


(5.2) 
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Notice  that 

Q"  £  Q'  (5.3) 

If  m  is  nonempty,  Q"  is  said  to  be  an  uncertainty  set  containing  patterned  block-structured  uncer¬ 
tainty. 

The  set  Q"  satisfies  properties  P1-P4  of  Section  3  and  like  Q'  is  convex.  Since  Q"  C  Q' 
the  robustness  results  of  Theorem  4.1  apply  with  Q'  =  Q".  However,  (if  n  is  nonempty)  the 
additional  structural  information  associated  with  the  uncertainty  set  Q"  allows  the  development 
of  less  conservative  results.  Below,  we  develop  a  recursive  methodology  to  obtain  robust  stability 
conditions  and  performance  bounds.  Each  stage  of  the  recursion  yields  robustness  results  which 
can  be  significantly  less  conservative  than  the  results  of  the  previous  step  and  are  guaranteed  to 
never  be  more  conservative. 


The  development  of  this  section  begins  by  showing  that  the  robustness  properties  of  the  system 
(3.1)  can  be  determined  by  analyzing  any  one  of  a  sequence  of  equations.  First,  for  k  E  {0, 1,2, . . .} 
consider  the  equation 

</»  -  (-p<j)*v*> = [  n  + (-po)’*)]*  (s.4) 

msO 

where  we  use  the  convention  ^ 

ri  ( in+(-pQ)7")=in  (5.5) 

m=0 

and  x  is  defined  by  (3.26).  Also  recognize  that 

n  (/n  +  (-PQ)*“)=  for*  =1,2,...  (5.6) 

m=0  m=0 

(Note  that  the  argument  s  is  implicit  in  (5.4)-(5.6)).  An  important  theorem  is  now  presented. 

Theorem  5.1.  Let  k  E  {0, 1,2,. . .}.  Then  the  system  (3.1)  is  robustly  stable  for  Q  =  Q"  if  and 
only  if  for  each  Q(s)  E  Q" 

det  -  (  -  P(ju>)Q(ju>))3  ]  #  0  for  all  w.  (5.7) 


In  this  case,  for  each  Q(s )  E  Q"  and  R(s)  E  R  the  error  vector  c(joj)  which  solves  (3.25)  is  given 
by 


e(joj)  =  e^k\ju/) 


(5.8) 
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where  e^ljui)  satisfies  (5.4)  with  x (ju)  given  by  (3.26). 


Proof.  The  proof  is  found  in  Appendix  C  and  uses  Lemma  C  which  is  also  presented  in 
Appendix  C.  □ 

Now  for  k  €  {0,1,2...}  and  each  Q(s)  €  Q"  and  R(s )  €  R  define 

TW(M  =  (-P(ju)Q(ju)f  (5.9) 

k-i 

X{k)(ju)  =  [  n  (^  +  T^(ju,))]x(ju)  (5.10) 

m=0 

where  x(jw)  is  given  by  (3.25).  and  x^  have  the  partitioned  forms 

r“>  =  . ,)  (5.ii) 

(*'*I)T  =  [(«<*>)* . (*<‘>)T]  (5.12) 

where  €  C n‘ * n>  and  x\k^  €  Cn'.  Now  choose  r  x  r  T^(ju)  and  r  dimensional  x(ju>)  such 
that  for  each  Q(s)  €  Q"  and  iH(s)  e  R 

TW(jw)  <<  T(k){ju)  for  all  w  (5.13) 

x~  <<  x(fc)(jw)  for  ail  u>.  (514) 

Notice  that 

T<k+1\ju>)  =  [T(fc)(jw)]2  (5.15) 

x(*+%'w)  =  [In  +  TW{ju))xW{ju).  (5.16) 

It  then  follows  from  (5.19),  (5.20)  and  the  block  norm  inequalities  (2.7)-(2.9)  that  it  is  always 
possible  to  choose  sequences  (T^^jw)} and  (x^(jw)}^_Q  such  that 

f  (fc+1)(jw)  =  [f 1 <%u/)]J  for  all  «  (5.17) 


x(k+l){j<jj)  =  [lr  +  T(fc)(jw)j x(fc)(j'w)  for  all  w.  (5-18) 

However,  in  general  it  is  possible  to  choose  the  sequences  {TW^'w)}^  and  {x(fc)(jw)}£l0  suc^ 
that 

f(fe+1)(iw)  <<  [f  <fc>(jw)]*  for  all  w  (5.19) 

x(fc+1)(ju/)  <<  [/,  +  f(fc)(yw)l*^)(y«)  for  all  «.  (5.20) 


This  fact  is  illustrated  by  the  following  example.  This  example  corresponds  to  considering  a  system 
of  the  form  (3.1)  at  a  fixed  frequency  u/q. 

Example  5.1.  Suppose 

P{juo)  =  block-diag  {  Pi  (ju>o) ,  Pi  (j^o) } 


where 


P i  (iwo)  = 


1  0 
0  0  ’ 


Pi(jua)  = 


0  0 
0  1  ’ 


where 


Wljuo)  = 


0 

WjiO'wo) 


Wij(jwo) 

0 


W^u(jwo)  = 


1  0 
0  0  ’ 


Wji(iwo)  = 


0  o' 

0  1  ’ 


Q(w0)"  €  {Q(jw0)  G  <C4x4  :  Q(ju 0)  =  /3(juo)W(ju>o)t  |  0(juo)  |<  q(ju/o)} 


and 

iTC?w0)  =  [xf(j'wo),  zfU" o)]- 

where 

xl(jv0)  =  (1,0],  zf(jwo)  =  [0,1]. 

Then  for  each  Q(jwq)  E  Q(w0)" 


T(0)(iw0)  =  PQ(M)  =  -/Stfwo) 


0 

P 2^21  (.7  wo) 


0 


and 


T(1>(>o)  =  -[PQO'wo)]2  =  -0(juo)2 


PiW13P,W21(ju0) 

0 


0 

P2TV31P1^12(jw0) 


z(0)(j'wo)  =  x(iw0)  = 
x(1)(i"o)  =  [h  +  ^(°Hiwo)]x(0)(,7Wo)  = 


*i  (jw0) 
X2(jw0) 


Xl(jWo) 

[X2(jw0) 


-  P{ju o) 


PlWri2X2(iwo) 
^2  W21X1  (jwo). 


Choose 

T^°\jv  0)  =  q(jvo) 
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This  is  the  smallest  possible  choice  of  T^(ju q)  in  the  sense  that  there  exists  Q{jujo)  €  Q(w0)" 
such  that  T^°\j<jJo)  =  T^(ju0).  Noticing  that  WnPt[juo)  =  W2iP\  (i^o)  =  0  it  is  possible  to 
choose 

T(1)(jojq)  =  0  <<  [T^(joj o)]  = 


Now  choose 

i(0)0‘wo)=  j 

This  is  obviously  the  smallest  possible  choice  of  x^(j'wo)  since  x^(jwo)  =  x^^'aio).  Now  notice 
that  PiWi2Zi(j<*>o)  =  PiW21x3(joj0)  =  0.  Thus  it  is  possible  to  choose 


x(1)(jw0)  =  x(0)(iw0)  <<  (/  +  Tio)){jujo)xw[juo)  =  (l  +  «(iw0)) 


1 

1 


.□ 


The  main  results  of  this  section  are  now  presented  below  in  Theorem  5.2  and  Corollary  5.1. 
Theorem  5.2  provides  a  sufficient  condition  for  robust  stability  while  Corollary  5.1  provides  the 
foundation  of  a  recursive  methodology  for  obtaining  less  conservative  bounds. 

Theorem  5.2.  Suppose  Q  =  Q"  and  consider  any  k  €  {0, 1, 2, . . .}.  Then,  if 

p[^(*)(jo/)]  <  1  for  all  ui,  (5.21) 

the  system  (3.1)  is  robustly  stable.  In  this  case,  a  performance  bound  is  given  by  e^(ju)  where 

±  [Ir  -  f(fc)(jw)]  -1*(fc)(j«).  (5.22) 


Proof.  The  proof  of  this  theorem  depends  upon  Theorem  5.1  and  is  essentially  identical  to  the 
proof  of  Theorem  4.1  found  in  Appendix  A.  □ 

Corollary  5.1.  Suppose  Q  =  Q"  and  the  sequences  {f'(fc)(jW)}^_o  and  {x^fc^(jw)}^.0  satisfy 
(5.19)  and  (5.20).  Then,  if  for  some  m  €  {0,1,2,.. .} 

p[f(m)(iw)]  <  1  for  alia;,  (5.23) 

the  system  (3.1)  is  robustly  stable.  In  this  case,  for  any  k  >  m 

p[T^{ju})]  <  1  for  all  a /  (5-24) 

and  e^k\ju>)  defined  by  (5.22)  is  a  performance  bound.  In  addition 

^(*+1)(yw)  <<  e^k\ju>)  for  all  a;.  (5.25) 


I 
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Proof.  The  inequality  (5.24)  is  a  direct  consequence  of  (5.21)  and  (5.19).  That  e^(Ju)  is  a 
performance  bou’-  1  then  follows  immediately  from  Theorem  5.2. 

Now  c(k)(ju>)  satisfies 

[It  ~  fwUv)]#k'U»)  =  xw(juj).  (5.26) 

Premultiplying  (5.26)  by  the  invertible  matrix  [ Ir  +  T^(ju)]  and  rearranging  gives 

ilk)(j“)  =  [f  W(yw)]*eW(i«)  +  [Ir  +  f(^(jW)]f(^(jW).  (5.27) 

It  then  follows  from  (5.19)  and  (5.20)  that 

i{k)ju  >>  T{k+1\juj)^k)Uuj)  +  i(t+1)(jw).  (5.28) 

Thus,  there  exists  0  €  IR+  such  that 

e(fc)(jw)  =  +  *(k+l>(/u,)  +  0.  (5.29) 

Next  notice  that 

e(fc+l)(jw)  =f(fe+l)(jw)e(fc+1)(yw)  +  i(k+1)(jw).  (5.30) 

Subtracting  (5.30)  from  (5.29)  and  rearranging  yields 

[e(k)(jw)  -  e{k+1>(iw)]  =  [Ir  -  f<k+1>(jw)]_10.  (5.31) 

It  follows  from  (5.24)  that  [/r  -  T^k+1^(j'w)]  is  an  M-matrix  and  thus 

[I,  -f<fc+1>(,w)]“I  >>  0  for  all  w.  (5.32) 

The  inequality  (5.25)  follows  from  (5.31)  and  (5.32).  □ 

Remark  5.1.  If  (5.23)  is  satisfied,  then  since  the  sequence  {^fc)(jw)}^Lm  is  bounded  below 
by  the  zero  vector  and  is  monotonically  nonincreasing  (i.e.,  it  satisfies  (5.25)),  it  is  guaranteed  to 
converge. 

Remark  5.2.  Recognize  that  the  calculation  of  successive  members  of  the  sequences 
{ ^(*)(iw)}fcL0  and  **  increasingly  complex. 

Remark  5.3.  It  is  always  possible  to  choose  f^(ju)  and  x^(jw)  such  that 

e(°)(jW)  <<  e(-)(ju;)  for  all  u>  (5.33) 

where  e^~^(juj)  is  the  bound  defined  by  (4.4). 

Corollary  5.1  is  the  basis  of  the  following  recursive  algorithm  for  the  analysis  of  robust  stability 
and  performance. 
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Recursive  Algorithm  for  Robustness  Analysis 

This  algorithm  assumes  that  for  some  p  £  {0,1,2...}  the  sequence  satisfies  (5.21) 

for  k  >  p. 

Step  1:  Initialize  m  =  0. 

Step  2:  Determine  if  satisfies  (5.28). 

Step  3:  If  T(m)(j'w)  satisfies  (5.28)  go  to  Step  4.  If  does  not  satisfy  (5.28)  and  m  <  p,  then 

let  m  +-  m  +  1  and  go  to  Step  2.  If  f^(juj)  does  not  satisfy  (5.28)  and  m  =  p  then  stability 
cannot  be  guaranteed  and  the  algorithm  stops. 

Step  4:  Let  k  =  m. 

Step  5:  Compute  the  performance  bound  e^(ju).  If  the  bound  is  close  (or  equal)  to  the  limit  of  the 
sequence  {e^fc^(jw)}^_m  or  is  satisfactory  in  some  other  sense  considered  by  the  analyst,  then 
stop.  Otherwise  go  to  Step  6. 
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Step  6:  Let  A:  <—  k  +  1  and  go  to  Step  5. 


6.  An  Illustrative  Example 

Consider  the  configuration  of  Figure  6.1  which  describes  two  oscillators  with  uncertain  coupling. 
This  system  can  be  described  by  (3.1)  with 


Notice  also  that 


yT(s)  =  [yf («)>  yf (»)] 

=  [viT(»).  »?(*)] 


*(•)  =  p(*)  = 

Q(s)  = 


\Pi  «  o 

o  P.{») 


0  Qn(s) 

<?2l(s)  0 


P,(s)  = 


s  +  Vi  n , 

-Hi  s  +  Vi 


{s  +  ViY  +  nl 

The  nominal  output  y°  (corresponding  to  Q°(s)  =  0)  is  given  by 


y°(s)  =  P(s)v(s). 


(6.1) 

(6.2) 

(6.3) 

(6.4) 

(6.5) 

(6.6) 


n 


4 
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In  addition,  the  error  vector 


(6-7) 


«(«)  =  y(«)  -  y°(«) 


is  given  by 


where 


or  equivalently 


Now  let 


where 


[f4  +  P(s)Q(s)]e(s)  =  x(s) 

(6.8) 

x(s)  =  -P(s)Q(s)P(s)v(s) 

(6.9) 

xi(a)  __  •Pi(«)<5ij(s)P2(s)u2(s)‘ 

*a(*)J  [P2(s)Q21(s)P1(s)v1(s) 

(6.10) 

(6.11) 

,,,(“)'<’(I'v®rTnj) 

(6.12) 

(6.13) 

Also,  let  Q  be  given  by  where 

Qjs  =  {<?(«)  €  S4*4  :  Q(ju )  <<  Q(j'w)}. 

Subsequent  results  consider  the  case 

Vi  =  i/j  =  0.005 
=  i.o,  n2  =  io.o 
fix  =  n5  =  5.o 
vi  (jv)  =  (jw)  =  [o  1]. 

Standard  singular  value  analysis  assures  stability  if 

a(P(ju>))  L(v)  <  1  for  all 

where 

L(w)  =  max  {g*i2(u>),  g2i(w)}. 


(6.14) 

(6.15) 

(6.16) 

(6.17) 

(6.18) 


(6.19) 


(6.20) 
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For  the  case  under  consideration  the  condition  (6.19)  is  satisfied  only  for 


a  <  0.0051. 


(6.21) 


However,  the  stability  condition  of  Corollary  4-1  shows  that  the  system  is  actually  stable  if  and 
only  if 

a  <  0.428.  (6.22) 

comparing  (6.21)  and  (6.22)  demonstrates  the  conservatism  sometimes  inherent  in  singular  value 
analysis. 

Figure  6.2  shows  a  plot  of  ||j/i0'w)||j  and  ||y2(ju)||2  versus  c o.  For  a  =  0.3  Figures  6.3  and  6.4 
show  plots  of  e[~\ju)  and  ej""^(jw)  respectively  versus  w,  computed  using  (4.3)  with 


xT  (ju)  =  [if  (jw) ,  if  (joj)] 


(6.23) 


where 


xi(ju)  =  l!-PiO'w)l!5?ii(w)||P2(iw)t;2|j2 

x2(jw)  =  ||P2(iw)|Ug2i(w)||Pi(iwjt;i|!2. 


(6.24) 

(6.25) 


The  latter  plots  shows  the  possible  performance  degradation  in  the  outputs  yi  and  y2  due  to  the 
system  uncertainty. 

Now  assume  that  the  patterns  of  the  subblocks  of  Q(a)  are  known  in  addition  to  bounds  on 
the  norms  of  the  subblocks.  In  particular  let  W j2  and  W2\  be  the  constant  matrices 


Wi2  =  i  f l.  i 


W21  =  r  • 


2  1 
1  r  1  -3 


and  notice  that 


Now,  let  Q  be  given  by  Qfi  where 


2  I  3  1 


ll^iall.  =  ll^2ii|.  =  l. 


Q "e  -  {<?(«)  e  Qb  :  for  all  u,Ql2(ju)  =  012(w)W12, 

Q2i(jw)  =  ft2i(w)W2i,  I  (}\2(w)  |<  9i2(w),  I  /S2i(o/)  |<  q2i(u>)}, 

and  qi2(u>)  and  ?n(w)  are  defined  by  (6.12)  and  (6.13). 


(6.26) 


(6.27) 


(6.28) 


(6.29) 


19 


Now,  notice  that 


0  P1Q12 

P2Q21  0 


t?w). 


TW(ju)  =  -P{ju)Q(ju)  =  - 

TW(ju)  =  (~PU“)QU «))*  = 

x(0)(jw)  =  x(jU>), 

I<»0--)=  [/+J«UB)]«C#U)-^B)+ 

Choose  as 

T  {0)CH  = 


P1Q12P2Q21  0 

0  P2Q2lPlQli\ 


(6.30) 

CM. 

(6.31) 

CM- 

(6.32) 

. „  ,° 

O'")  0 


where 


=  ?uMIIWs||s(iu,) 

(1°i,(iw)  =  ?2iM||P2lV2X  ||s(jw); 

fW(ju>)  = 


where 


where 


0  *SV(y«) 

SO)  = 

*n0”)  =  hifaWHPiWiiPMtllsbu,); 

i(0,0")=f!f^"’l 

L*J  CM 

x^Ow)  =  gnHUPi^uPjvjlljOc;) 

ij0)(^)  =  feiHllftWnPiWrlliOw); 


*(1)(M  = 


where 


(6.33) 

(6.34) 

(6.35) 

(6.36) 

(6.37) 

(6.38) 

(6.39) 

(6.40) 

(6.41) 

(6.42) 


=  ii°)(i")  +  &iMw)llWiWaPj»a||a(M  (6.43) 

*2  ^CM  =  *2  ^ CM  +  7l272l(w)||Pl5l2P2^2lPlVl||2(jw).  (6.44) 

For  k  —  0,  the  robust  stability  condition  of  Theorem  5.2  shows  that  the  system  is  stable  for 

a  <  0.470  (6.45) 
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which  describes  a  larger  stability  region  than  (6.22).  For  k  =  1,  the  robust  stability  condition  of 
Theorem  5.2  shows  that  the  system  is  stable  for 

a  <  1.5  X  10s  (6.46) 

which  is  a  much  less  conservative  result!  Since  for  this  example  for  k  €  {2,3, . . .}  one  must  choose 

fW(juj)  >>  [T^fyw)]*  for  all  w, 

(6.46)  describes  the  largest  stability  region  which  can  be  obtained  by  the  recursive  algorithm  of 
Section  5. 

Figure  6.3  shows  plots  of  2j°*(jfw)  and  e^(j'w)  vs.  w,  computed  using  (5.27)  with  k  =  0. 
Likewise,  Figure  6.4  shows  plots  of  e^\ju>)  and  e^\ju)  vs.  w,  computed  using  (5.27)  with  k  =  1. 
As  insured  by  the  theory 

e^(/u>)  <  ei^Q'aj)  for  all  u>  (6.47) 

l\jw)  <  e^(ju>)  for  all  u>.  (6.48) 
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Summary 


This  paper  has  used  the  theory  of  nonnegative  and  M-matrices  to  develop  robust  stability  and 
performance  results  for  two  types  of  uncertainty  characterizations.  Performance  was  measured  in 
terms  of  the  deviations  of  the  system  outputs  from  their  nominal  values.  For  uncertainty  with  norm 
bounded  subblocks  the  development  led  to  a  frequency  dependent  multi-loop  small  gain  theorem. 
The  stability  result  was  shown  to  be  necessary  and  sufficient  when  the  nominal  transfer  matrix 
P(s)  is  block-diagonal.  For  uncertainty  that  has  subblocks  with  known  patterns  the  developments 
led  to  a  recursive  methodology  which  is  guaranteed  to  yield  increasingly  nonconservative  results. 

The  results  were  illustrated  by  considering  two  oscillators  with  uncertain  couplings.  The  fre¬ 
quency  dependent  multi-loop  small  gain  theorem  was  shown  to  yield  much  less  conservative  results 
than  standard  singular  value  analysis.  However,  for  a  given  case  in  which  the  patterns  of  the  un¬ 
certain  coupling  blocks  were  assumed  to  be  known  the  recursive  analysis  methodology  yielded  a 
stability  region  over  5  orders  of  magnitude  greater  than  that  obtained  by  using  the  multiloop  small 
gain  theorem.  The  recursive  methodology  also  yielded  better  (i.e.,  smaller)  bounds  on  the  output 
perturbations,  a  result  guaranteed  by  the  theory. 

Acknowledgements.  We  wish  to  thank  Jill  Straehla  for  the  excellent  typing  of  the  original 
manuscript,  Allen  Daubendiek  for  performing  the  numerical  computations,  Dennis  Bernstein  for 
several  helpful  comments,  and  Teresa  Rhodes  for  assisting  in  the  preparation  of  the  figures. 


Appendix  A 


Proof  of  Theorem  4.1.  First  recognize  that  since  Q  =  Q', 

(PQ)  <  PQ  for  all  u.  (A.l) 

(Here  the  block  norm  inequality  (2.8)  has  been  used.)  Now  assume  that  the  system  (3.1)  is  robustly 
stable  for  some  Q  E  Q'.  Then  the  corresponding  output  perturbation  eq  is  bounded  on  the 
imaginary  axis  and  satisfies 

eq  =  PQeq  +  x  for  all  u.  (A- 2) 

It  follows  by  using  (A.l),  (4.4)  and  the  block  norm  inequalities  (2.8)  and  (2.9)  that 

eq  <  <  PQeq  x  for  all  u  (A. 3) 

or  equivalently 

(Jr  -  PQ)eq  <<  i  for  all  u.  (A.4) 

If  p[PQ )  <  1  (i.e.,  Ir  -  PQ  is  an  M- matrix)  for  all  u,  then  [Ir  -  PQ)~ 1  €  IR^xr  for  all  u. 
Premultiplying  (A.4)  by  (Jr  -  PQ)~ 1  then  gives 

eq  <<  e  for  all  u  (A. 5) 

where  e  is  the  solution  of 

e  =  {Ir-PQ)~1x.  (A.6) 

Next  assume  that  ( Ir  -  PQ)  is  an  M-matrix  for  all  w  and  that  the  system  (3.1)  is  not  robustly 
stable.  Recognize  that  for  w0  E  IR  |det[/r  +  •P(.7w(,)Q(ju;0)]|  is  a  continuous  function  of  Q.  Define 

f(Q)  —  j"f  I  det(/r  +  PQ)\-  (A.7) 

The  function  f(Q)  is  also  continuous  in  Q.  In  addition,  the  system  (3.1)  is  stable  for  Q  E  Q'  if  and 
only  if  f{Q)  >  0.  Now  there  always  exist  a  neighborhood  in  Q'  of  Q  =  0  such  that  for  each  Q  in 
the  neighborhood,  /(<?)  >  0.  Since  Q;  is  convex,  there  exist  Q„  E  Q'  such  that  f(fxQ0)  >  0  for 
p  E  [0, 1)  and  f(Q0)  =  0-  It  follows  that  for  p  E  [0, 1) 

--  *  f°r  u  (A. 8) 
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and  there  exists  w„  E  IR  such  that 


lim 

M-.1 


det  [lr  +  nP(ju0)Q(juo)} 


=  0. 


The  limit  (A.9)  implies  that 

lim  i|e^<3.(iwo)||  =  00 

M— 1 

which  implies  there  exists  fi0  €  [0, 1)  such  that 


(A.9) 


(A. 10) 


(All) 


This  contradicts  (A. 8)  and  ends  the  proof.  □ 
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Appendix  B 


Proof  of  Corollary  4.1.  The  sufficiency  of  (4.2)  for  robust  stability  is  guaranteed  by  Theorem 
4.1.  So  assume  that  for  some  wo  £  IR 

p[P{juj o)j  =  a  >  1.  (B.l) 

It  will  be  shown  that  there  exist  Q(s)  £  Q'  such  that 

p[P(jw0)fi(jw0)]  =  1.  (B.2) 

First  recognize  that  since  (B.2)  implies  that 

det  [/  -  P{ju0)QUuo )]  =  0,  (B.3) 

it  also  implies  that  the  system  (3.1)  is  unstable  for  Q(a)  =  Q(s). 

Now  let 

P  =  P(juo)  (B.4) 

n  =  <3(iw  o)  (b.5) 

n  =  {necnxn:n<<n}.  (b.6) 

Here  it  is  assumed  that  each  Q  €  fl  has  the  partitioned  form 

n  =  (%](.',/=  l . 0  (B.7) 

where  H ,-y  €  (Cn<x,li.  Since  P(s)  is  block-diagonal, 

P  =  block-diag{?, . . . ,  Pr}  .  (B.8) 

where  Pi  £  <Dn<Xn<.  Also,  in  the  new  notation  (B.2)  is  equivalent  to 

p[7fl]  =  a.  (B.9) 

Now  for  each  fi  £  fl  there  exist  a  <3(s)  £  Q  such  that  Q(jv o)  =  fl-  Thus,  it  suffices  to  complete 
the  proof  by  showing  that  there  exist  fi  £  fl  such  that 


P(pn)  =  l. 


(BIO) 


For  each  fi  G  ft,  PCI  is  given  by 


™ = [(«>)«)*., . . 


where 


{pn)ij  =  *ay. 

Let  the  singular  value  decompositions  of  the  diagonal  blocks  of  P  be  given  by 


Pi  —  Ei'ZiF^1 ,  i  —  1, . . . ,  r 


where 


(EOn  =  11*11.- 

Now  choose  Q  such  that  its  block  partitions  have  the  singular  value  decompositions 


Clij  —  FiAijEj  ,  i,j  —  1, . . . ,  r 


where 


(A»y)n  =  nu. 


Clearly,  Q  G  H  and 


n  =  n 


In  addition, 


(PCfyij  —  EiEkijEj  ,  x,j  —  1, . . . ,  r 


which  implies 


(^n)  =  p  n 


Next,  let 


n  =  -Cl. 

a 


(E 


(B 


(B 


(E 


(E 

(E 

(E 

(E 


(E 


Recognize  that  Fl  G  fl  and  the  block  partitions  of  PF1  have  the  singular  value  decompositions 


(Pfl)t]  —  EiAijE;  ,  i,j  —  1, . . . ,  r 


(F 


It  follows  that 


(pn)  =  pn  =  ^p  n.  (B.23) 


It  is  easily  seen  from  (B.9)  and  (B.23)  that 

p(Pn)  =  1  (B.24) 

Define  the  unitary  matrix  U  £  <D”Xn  by 


U  =  block-diag{  Ei , . . . ,  Er } 

(B.25) 

and  let  TV  be  given  by 

mi  =  uH(pn)u. 

(B.26) 

Note  that  TV  is  an  n  x 

n  ncnnegative  matrix  and  has  the  partitioned  form 

V  =  Khw-i . rj- 

(B.27) 

In  addition, 

mi  =  pn 

(B.28) 

and  thus 

p(M>)  =  1. 

(B.29) 

Let  it  £  IR+  be  the  eigenvector  of  IV  corresponding  to  the  Perron  root  (p(TV)  =  1).  Then, 


Mlu  =  ti. 

(B.30) 

Now  define  p  £  IR"  by 

pT  =  [pl,...,p?} 

(B.31) 

where  m  €  IR+  is  given  by 

M?  =  [«  i  0  •  •  ■  0] . 

(B.32) 

(Here  Uj  is  the  ith  element  of  u).  Then, 

Mlp  =  p. 

(B.33) 

To  see  this,  recall  that  Ml  is  given  by  (B.27)  and  notice  that: 


where  A?*  E  IR+ x  n<  is  diagonal  and 


(A“)n  =  Vii. 


(B.35) 


(ii)  If  m  >  nj, 


where  A°j  E  IR”’ x  ny  is  diagonal  and 

(4)n=¥«i- 

It  follows  from  (B.26)  and  (B.33)  that 


(B.36) 


(B.37) 


P{pn)  =  p(w)  =  i. 


(B.38) 


Thus,  the  corollary  is  proved.  □ 


Appendix  C 


This  Appendix  presents  and  proves  Lemma  C  and  then  presents  a  proof  of  Theorem  5.1. 

Lemma  C.  Consider  any  k  £  {1,2,3 . . . , }.  Then,  the  system  (3.1)  is  robustly  stable  for  Q  =  Q" 
if  and  only  if  for  each  Q(s)  €  Q" 

p^(P(ya;)(5(yw))fcj  <  1  for  all  u>.  (C.l) 


Proof.  Suppose  (C.l)  holds  for  each  Q(s)  €  Q”.  Then 

p[P(ju)Q(ju>)]  <  1  for  all  w 

which  implies  that 

det  [/  +  #  0  for  all  w. 

Theorem  3.1  then  guarantees  that  the  system  is  robustly  stable. 

Now  suppose  that  for  some  w  €  IR  and  Q(s)  €  Q" 

p[(pC7w)<?(yw))fc]  =  afc  >  1. 

This  implies  that  for  some  9  G  IR  an  eigenvalue  of  P(juj)Q(juj)  is  given  by 

A[P(jw)g(jw)]  =  aexp(0) 

where  a  >  1. 

Next  define 

<?(*)  =  -iexp(-0)g(s). 

Clearly,  Q(s)  €  Q"  and  there  exist  an  eigenvalue  of  P{js)Q(jw)  given  by 

A[P(jw)4>(;'w)]  =  -1. 


Thus, 


det  [I  +  P(ju)Q(j<jj)]  =  0 


and  by  Theorem  3.1  the  system  is  not  robustly  stable.  □ 


(C.2) 

(C.3) 

(C.4) 

(C.5) 

(C.6) 

(C.7) 

(0.8) 
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Proof  of  Theorem  5.1.  First  it  is  shown  that  for  each  Q(s)  E  Q" 


det  [/„-(  —  P{ju)Q{ju))*  ]  0  for  all  w 

(C.9) 

if  an  only  if  for  each  Q[a)  E  Q,; 

p^{P{j<jJ)Qtiu>))7  ]  <  1  for  all  w 

which  by  Lemma  C  is  a  necessary  and  sufficient  condition  for  robust  stability. 

(C.10) 

It  is  obvious  that  if  (C.10)  is  satisfied  for  each  Q(a)  E  Q",  then  (C.9)  is 
Q(s)  E  Q”.  So  assume  that  there  exist  Q°(s)  E  Q,;  and  wo  6  IR  such  that 

satisfied  for  each 

p[{Ptiuo)Q0tiuo))7  ]  =  a  >  1. 

Then  for  some  0  E  IR  an  eigenvalue  of  (P(j<^o)Q° *  is  given  by 

(C.ll) 

a[(P(jw0)<50(jwo))J  ]  =  aexp(0). 

(C.12) 

Now,  let 

Q(s)  =  (-lf±*xp(-e)Q(s). 

Clearly,  Q(s)  E  Q  and  there  exist  an  eigenvalue  of  (P(jwo)Q(juo))2  given  by 

(C.  13) 

*[(^(jwo)Q(y«0))*  ]  =(-i)ak 

(C.14) 

which  implies 

det  In-  (  -  P{jwo)Q(j(jJo))2  =  0. 

(C.15) 

The  proof  is  completed  by  showing  that  if  the  system  is  robustly  stable,  then  for  each  Q[s)  E  Q 
and  R(s )  E  R 

e\Ju)  =  e{k){ju).  (C.16) 

So  assume  that  the  system  (3.1)  is  robustly  stable  and  consider  Q(s)  E  Q”  and  i?(s)  E  R.  Then 
e(juj)  is  the  unique  solution 

[J»  +  pO‘u)Q(jw)  ]«(/«)  =  xU<*>)  (c.  17) 

where  i(jw)  is  obtained  from  (3.26).  Also,  let 

fc-i 

©g(j«)  =  II  (7-  +  ( -  n3*)Q{juj)'~)  (c.i8) 

m=0 


r Q{ju)  =  Qq(ju)  [  -  In  +  P{j«)QU»)]  ■ 


(C.19) 


It  is  easily  shown  by  induction  that 

Tq(M  =  In  -  (  -  P(ju)Q(ju))2k.  (C.20) 

Since  the  system  is  robustly  stable,  (C.9)  insures  that 

det  [©q(jw)]  ^  0  for  all  uj.  (C .2 1) 

Then,  premultiplying  (C.18)  by  0q(j'u;)  and  using  (C.17)  by  &q(jw)  and  using  (C.19)  shows  that 

r<3(i<*>)e(jw)  =  eQ{ju/)x(ju).  (C.22) 

Finally,  using  (C.18)  and  (C.19)  and  comparing  (C.22)  and  (5.8)  shows  that  (C.16)  holds.  □ 
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Abstract 

Six  methods  f or  design  of  reduced-order 
coapensation  are  conpared  using  an  example  problea 
given  by  Enns.  The  methods  considered  cosiprise 
five  LQG  reduction  techniques,  reviewed  in  a 
recent  paper  by  Liu  and  Anderson,  and  the  Optimal 
Projection  theory  as  implemented  via  a  simple 
hamotopy  solution  algorithm.  Design  results 
obtained  by  the  different  methods  for  forty-two 
different  design  cases  are  compared  with  respect 
to  closed-loop  stability  and  transient  response 
characteristics.  Of  the  LQG- reduction  procedures 
two  are  found  to  offer  distinctly  superior 
performance.  However,  only  the  Optimal  Projection 
method  provided  stable  designs  in  all  cases. 
Further  details  are  given  on  the  performance  of 
the  numerical  algorithm  for  solving  the  optimal 
projection  equations  and  the  corresponding  design 
results. 

1.  Introduction 

The  design  of  reduced-order  dynamic 
controllers  for  high-order  systems  is  of 
considerable  importance  for  applications  involving 
large  spacecraft  and  flexible  flight  systems. 

Hence  it  is  not  surprising  that  extensive  research 
has  been  devoted  to  this  area.  A  recent  paper  by 
Liu  and  Anderson  [l]  subjected  five  reduced-order 
controller  design  methods  to  both  theoretical  and 
numerical  comparison.  The  computational 
comparison  was  based  upon  an  example  problem 
considered  by  Enns  [2].  The  five  methods  compsred 
in  [1]  are: 

1.  Method  of  Enns  [2] :  This  method  is  a 
frequency-weighted,  balanced  realisation 
technique  applicable  to  either  model  or 
controller  reduction 

2.  Method  of  Glover  (3] :  This  method 
utilizes  the  theory  of  Hankel  norm 
optional  approximation  for  controller 
reduct  ion 

3 .  Davis  and  Skelton  [4] :  This  is  a 
modification  of  compensator  reduction  vis 
balancing  which  covers  the  case  of 
unstable  controllers 
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4.  Tousuff  and  Stelton  L5j :  This  is  a 
further  modification  of  balancing  for 
handling  stable  or  unstable  controllers 

3.  Liu  and  Anderson  [1]:  In  place  of  using 
a  balanced  approximation  of  the 
compensator  transfer  function  directly, 
this  method  approximates  the  component 
parts  of  a  fractional  representation  of 
the  compensator. 

All  of  the  above  methods  proceed  by  first 
obtaining  the  full-order  LQG  compensator  design 
for  a  high-order  state-space  model  and  then 
reducing  the  dimension  of  this  LQG  compensator. 

The  present  paper  complements  the  results  of 
Liu  and  Anderson  by  giving  a  numerical  comparison 
(again  using  Enns'  example)  of  methods  1-5  with  a 
sixth  method: 

6.  Optimal  Projection  (OP)  equations  [6]: 
Reduced-order  compensator  design  by 
direct  solution  of  the  necessary 
conditions  for  quadratically  optimal 
fixed-order  dynamic  compensation. 

Method  (6),  like  methods  (1-5),  has  been 
shown  to  have  intimate  connections  with  balancing 
ideas  [7] .  Moreover,  the  first  step  in  one 
iterative  method  for  solution  of  the  OP  equations 
is  almost  identical  to  method  (4) .  Method  (6) 
differs  from  the  other  methods,  hmever  in  that  it 
does  not  reduce  the  order  of  a  previously  obtained 
LQG  design  but  rather  directly  characterizes  the 
quadratically  optimal  compensator  of  a  given 
fixed-order.  The  OP  equations  constitute  four 
coupled  modified  Riccati  and  Lyapunov  equations 
wherein  the  steps  of  regulator  design,  observer 
design  and  order  reduction  are  completely  and 
inseparably  intermingled. 

The  organization  of  this  paper  is  as  follows. 
In  section  2,  we  state  tha  problem  considered  and 
review  the  OP  design  equations.  Section  3  gives 
the  computational  algorithm  used  herein  for  OP 
design  synthesis.  Finally,  section  4  sets  forth 
the  example  problem  of  Enns  and  ccmparea  the 
results  of  sll  six  methods  obtained  for  this 
example. 

2.  Problem  Statement  and  Review  of 
OP  Design  Equations 

Here  we  consider  the  linear,  finite¬ 
dimensional,  time- invariant  system: 

|i| 

x  =  Ax  +  Bu  ♦  Wjj  x  c  R  , 

(1) 

p 

y  *  Cx  ♦  v2;  y  €  R 


1 


where  x  ia  tba  place  state,  A  is  tba  plant 
dynamics  matrix  and  B  and  C  are  control  input  and 
sensor  output  matrices,  respectively,  w^  is  a 

white  disturbance  noise  with  intensity  matrix 
V,  0  and  w^  is  observation  noise  with 

nonsingular  intensity  >  0. 


*  NxN  ‘  NxN 

Lemma  1 .  Suppose  Q  € R  and  P  €  R  are 

nonnegative  definite  and  rank  (Q)  =  rank  (P)  = 

rack  (QP) .  Then  the  product  QP  is  seaisimple  (all 
Jordan  blocks  are  of  order  unity)  with  real,  non¬ 
negative  eigenvalues.  Moreover,  there  exists  a 

nonsingular  ♦(Q.P]  such  that: 


The  reduced-order  compensation  problem 

consists  in  designing  a  constant  gain  dynamic 

compensator  of  order  N  <  N: 

c 


u  *  -Kq,  u  €  R^ 

N 

q  =  Acq  +  Fy;  q  €  R  .c 


(2) 


+_1  [Q.PlQP'HQ.P]  *  A2 
*TlQ.P]P*(Q.P]  *  A 
*“1lQ.P]Q*~T[Q.P]  *  A 

where 


(4e) 

(Ah) 

(4c) 


Obviously,  the  heart  of  the  design  problem  is  the  A  =  diag  (Afc) 

selection  of  the  constant  matrices  K,  F  and  A^.  k=l...N 


(5) 


Methods  1-6  all  associate  with  the  closed- 
loop  system  (1,2)  a  steady-state  quadratic 
perfotaance  index,  J: 

J  S  lim  J/lt.-tJ 
t,-t„— >• 


t 

o 


Rj  >,  0.  Rj  >  0 

Methods  1-5  first  design  an  LOG  compensator 
(select  K.  F,  Ac  to  minimize  J^)  and  then  reduce 

the  order  of  the  resulting  N  state  compensator. 
Thus,  in  methods  1-5.  the  quadratic  performance 
(3)  is  brought  into  play  ia  the  initial  LQG  design 
step,  but  a  variety  of  balancing  and  Hankel  norm 
approximation  ideas  are  utilized  for  the 
subsequent  compensator-order  reduction  step.  In 
contrast,  method  6  selects,  K.  F.  A£  by  addressing 

the  quadraticallv  optimal,  fixed-order 
compensation  problem  i.e.,  for  N£  fixed  (and  <  N) , 

choose  K,  F,  A^  to  minimize  J#.  The  OP  design 

methodology  proceeds  by  solving  the  first-order 
necessary  conditions  for  this  optimization  problem 
uaiag  the  new  fozms  for  the  necessary  conditions 
given  in  [6] .  The  basic  OP  design  equations 
reduce  to  four  modified  Lyapunov  and  Riccati 
equations  all  coupled  by  a  projection  of  rank  Ng. 

In  general  these  design  equations  produce 
compensators  that  cannot  be  obtained  by  reduction 
of  an  LQG  compensator  [7] . 

Methods  1-5  have  been  reviewed  extensively  in 
(1-5] .  and  will  not  be  discussed  in  detail.  Here 
we  shall  merely  review  the  OP  design  equations  to 
the  extant  needed  to  illustrate  the  solution 
algorithm  used  for  this  study. 

To  do  this,  a  few  preliminary  results  and 
notational  conventions  must  be  given.  First,  we 
have  Lemma  1.  [7] : 


is  the  positive  diagonal  matrix  of  the  square 
roots  of  the  eigenvalues  of  QP. 


When  for  a  given  pair  Q  and  P,  a  +(Q,P] 

exista  such  that  (4)  hold,  Q  and  P  are  said  to  be 
contragrediently  diagonalizable  and  balanced  (9] 

and  <KQ,P]  constitutes  a  simultaneous 
contragradient  transformation.  Determination  of 
such  a  transformation  is  the  fundamental 
mathematical  operation  of  balancing. 


Furthermore,  it  is  clear  that  the  quantities: 


nk(Q.P]  ft  *[Q.?]E(k)*~1[Q.P] 


(6) 


,(k) 


1;  m*n*k 
0;  otherwise 


form  a  set  of  mutually  disjoint  unit  rank 
projections  i.e.: 


nk[Q.p]nj(Q.F]  *nk(Q.p]6kj:  (7) 

Thus  the  sum  of  r  distinct  fi^s  ia  itself  a 

projection  of  rank  r.  Also  QP  can  be 
alternatively  expressed  as: 


QP  =  £nk  [QPlA2 
k*l 


(8) 


By  virtue  of  (8)  and  the  usage 
nk(QP]  the  eigen-projection  of 

the  kth  eigenvalue. 


in  [10] ,  we  tats 
QP  associated  with 


The  above  results  and  conventions,  together 
with  the  notations: 


E  =  BR^BT  (9a) 

£  *  cTv‘lc 
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(9b) 


(9c) 


K  *  R^S*? 


allow  us  to  state  the  sain  result  [6-8]  upon  which 
tha  OP  reduced-order  compensator  design  method  is 
based: 

Theorem  1.  Consider  the  quadraticslly 

optimal,  fixed-order  compensation  problem  with 

N  <  N  fixed, 
c  * 

•  *  JjyU 

Let  nonnegative  definite  Q,  P,  Q.  PeR  be 
determined  as  solutions  to  the  following 
equations: 


determine  an  extremal  of  the  performance  index  J. 

As  has  bean  remarked  in  [8] .  the  value  of  the 
performance  index  is  unchanged  by  any 
transformation  of  the  compensator  state  basis  -  in 

UyU 

other  words,  for  any  nonsingular  S  €  R  : 


F  *  QCTVj*  (14) 

PC  8K 

\  •  A  -  qE  -  EP 

with  Q  and  P  given  as  solutions  to  the  independent 
Riccati  aquations.  (10a. 10b).  with  a  o.  Hence 
when  N£  *  N.  the  design  equations  (10),  (11)  and 

(12)  immediately  reduce  to  the  LQG  design  for  a 
full-order  compensator. 

However  for  <  N,  aquations  (10)  are  first- 

order  necessary  conditions  and  generally  possess 
multiple  solutions  corresponding  to  multiple 
extremals  that  can  exist.  This  natter  was 
explored  in  [11]  relative  to  the  related 
quadratically  optimal  model  reduction  problem. 
Basically,  equation  (10c)  tells  us  that  the  rank 
projection,  t.  which  defines  the  geometry  of 

the  fixed-order  compensator,  is  the  sum  of  N£  out 

of  N  eigenp reject ions  of  QP.  However,  the 
necessary  conditions  do  not  tall  us  which  Nc  out 

of  N  eigenproj actions  are  to  be  selected  to  secure 
a  global  minimum  of  J.  Indeed  for  any  possible 
selection  of  Nc  eigenproj actions  out  of  N, 

equations  (10)  may  possess  a  solution 
corresponding  to  a  local  mxtranal.  By  virtue  of 
(10a)  and  the  notational  conventions  of  (4)  and 
(8) .  the  selection  of  N,  eigenprojections  is 

defined  (generically)  by  the  manner  in  which  the 
eigenvalues.  A^,  are  ordered.  Recently.  Richter 

[12]  has  applied  topological  degree  theory  to 
investigate  the  possible  solution  branches  and  tha 
character  of  the  associated  extrema  and  has 
devised  a  homotopy  solution  algorithm  which 
selects  the  A-ordering  which  homotopically 
converges  to  the  global  minimum. 

For  the  example  considered  in  this  paper,  we 
adopt  the  ordering  convention: 

Aj  i  Aj  2  •  •  •  2  Ajj  (15) 

in  constructing  4'[Q,Pj.  (15)  together  with  (10a) 

imply  that  r  is  taken  to  be  the  sum  of  the  Nc 

eigenprojections  corresponding  to  the  N,  largest 

eigenvalues  of  QP.  Generically,  this  choice  leads 
to  an  unequivocal  choice  of  one  solution  branch  of 
(10)  corresponding  to  a  particular  extremal. 


J(K.F.A)  «  J  (KS,S~*F,S~*A  S)  (13) 

c  c 

Furthermore,  when  N  >  9,  ris  a  rank  N 
c 

projection  on  R  by  virtue  of  (lOe).  Hence  T  *  1^ 

and  T|  *  0  and  equations  (10a), (10b)  become 
uncoupled  Riccati  equations  for  determination  of  Q 

and  P.  Also  T  and  G  become  ♦  *[Q,P]  and  ♦^[Q,P], 

Finally,  setting  S  *♦  '  and  using  (13)  and  (12), 
ext renal icing  gains  are  given  by: 


Thus,  the  OP  design  method  investigated  here 
consists  in  solving  (10)  with  convention  (IS)  and 
then  evaluating  tha  gains  according  to  (12).  We 
apply  a  simple  homotopy  solution  algorithm, 
described  in  the  next  section,  to  the  example 
problem  of  Enns  specified  in  Section  4  and  compare 
results  with  methods  1-5.  A  more  advanced  and 
efficient  homotopy  algorithm  is  given  in  [12]. 
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Figure  1:  Inner  Loop  at  OF  Solution  Algorithm 


3.  An  Algorithm  for  Solution  of  the 
OP  Design  Equation* 

As  stated,  chc  OP  design  method  is  to  solve 

(10)  (with  stipulstion  (15))  for  P,  Q,  P,  Q,  end 
then  evaluate  tbs  gains  using  (11),  (12).  A 
logically  distinct  issue  is  precisely  hoe 
equations  (10)  are  to  be  solved.  Here  we  present 
an  algorithm  that  has  been  used  for  some  rise  and 
requires  only  a  standard  LQG  software  package  for 
its  implementation.  For  convenience  this  same 
algoritha  was  eaployed  to  obtain  the  nuaerical 
results  for  method  6  presented  in  the  nest 
section. 

The  basic  motivation  of  this  algorithm  is  the 
observation  that  the  four  main  equations  {10a}- 
(lOd)  are  coupled  only  via  the  terms  involving 
on  the  right  band  sides.  If  these  terms  wars 
deleted,  then  all  five  equations  can  be  solved 
sequentially  -  moreover  (10a), (10b)  reduce  to 
ordinary  Riccati  equations  and  (10a), (10b)  are 
Lyapunov  aquations.  Likewise  under  conditions  in 
which  Q£Q  and  P£P  are  "small11  relative  to  the 
rmsaining  terms  (e.g.,  sufficiently  small  state¬ 
weighting  end  disturbance  noise  intensity  and/or 
sufficiently  large  control  weighting  and 
observation  noise  intensity)  the  terms  era 
typically  found  to  have  little  effect.  In  this 
situation  the  artiface  of  fixing  an  initial  T^, 
and  then  solving  (10)  as  ordinary  Riccati  and 
Lyapunov  equations  is  likely  to  give  a  reasonable 
approximation  to  the  true  solution. 


Since  only  the  terms  on  the  right  of  (lOe- 
lOd)  occasion  most  of  the  difficulties,  it  is 
necessary  to  somehow  bring  these  terms  into  play 
gradually.  There  are  two  principal  ways  to  do 
this.  The  first  is  an  iterative  relaxetion 
approech,  i.e.,  fix  r^,  solve  (10e}-(10d) 
sequentially,  than  update  r  using  (10a)  and  repeat 
until  convergence,  in  some  sense,,  is  achieved. 

The  second  method  is  a  hemotopy  approach,  i.e.. 
multiply  the  terms  by  a  scalar  parameter, 
a  €  [0,1],  then  starting  with  a  *  0  and  gradually 
incrementing  a,  solve  (10)  repeatedly  until  aw  1. 

The  algorithm  used  here  consists  of  two 
iterative  loops.  The  inner  loop  uses  the 
relaxation  approech  and  is  embedded  within  an 
outer  loop  which  implements  the  simple  homotopy 
approech. 

The  inner  loop  follows  the  earlier 
computational  scheme  discussed  in  [7]  and  is 
illustrated  in  Figure  1.  Note  that  the  parameter 
at  [0,1]  multiplies  the  terms  but  is  held  fixed 
within  the  inner  loop  and  is  only  incremented  on 
the  outer  loop.  As  Figure  1  shews,  one  first 
fixes  r  equal  to  the  previous  iterate  (or  set 

T  *  Ijj  when  starting)  and  then  solves  (10a)- 

(lOd).  Once  new  iterates  for  Q,  P,  Q,  P  are 
obtained,  r  is  updated  by  determining  the 

balancing  transformation  4>[Q,P].  To  enhance 
convergence  of  the  modified  Riccati  equations,  the 
updated  r  is  taken  to  be  the  weighted  sum  of  all  N 
eigenproj actions  -  the  first  N£  eiganproj actions 

are  given  unity  weight  while  the  rC^  (r  >  N,) 


eiganproj  action  is  weighted  by  Ar/AN  <  1.  As 

c 

convergence  proceeds,  A  /A„  approaches  aero  for 
r  c 

all  r  >  N  and  the  nuaerical  rank  of  T  approachs 
c 

Ng.  The  indicated  convergence  check  tests  the 
relative  excess  of  the  nuaerical  rank  of  r  over  N 

c 

and  terminates  the  inner  loop  iterations  when  this 
"rank  excess"  falls  below  tolerance  e.  In  these 
studies  €  =  0.1  is  used.  The  inner  loop  is 
terminated  when  either  this  tolerance  is  achieved 
or  when  the  prescribed  number  of  iterations  is 
exceeded. 

When  the  convergence  criterion  is  satisfied, 
the  gains,  K.  F.  Ac  are  computed  using  (11)  and 

(12)  and  the  steady-state  performance,  J.  is 
evaluated.  Performance  evaluation  invokes  no 
assumptions  regarding  the  convergence  and 
optimality  of  the  solutions  to  (10) . 

Specifically,  the  values  of  K.  F,  Ac  resulting 

from  application  of  (12)  are  accepted  as  they 
stand  and  are  used  to  construct  the  system 
matrices  of  the  augmented  system  with  state  vector 

X^  *  [x^,qT] .  Next  the  N+N  x  N+N  Lyapunov 

c  c 
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equation  for  the  sec  ond  moment  sat  rue  of  the 
augmented,  closed-loop  system  is  solved.  Finally. 
J  is  evaluated  as  s  linear  function  of  various 
sub-blocks  of  the  augmented  system  second  ecaent 
matrix. 

The  outer  loop,  depicted  in  Figure  2, 
implements  the  homotopy  approach  by  incrementing  a 
and  controlling  the  increment  step  sire.  Only  at 
the  start  is  the  inner  loop  initialised  by  r  *  X^. 

Otherwise,  when  a  is  incremented,  the  inner  loop 

is  initialized  using  P,  Q,  P,  Q.  and  T  as  obtained 
with  the  previous  value  of  a.  a  is  taken  to  be  0 
at  the  start  and  is  subsequently  incremented  by  A. 
The  default  value  of  A  is  0.1  although  other 
desired  values  may  be  input.  However,  whenever 
the  inner  loop  is  terminated  without  achieving  the 
convergence  tolerence  e,  the  homotopy  parameter 
increment,  A.  is  halved.  This  provides  simple 
control  over  the  homotopy  step  size.  The  entire 
algorithm  terminates  when  a  a  1.0.  Alternatively, 
at  the  user's  option,  the  algorithm  can  be 
terminated  whan  the  change  of  the  performance 
index,  J,  over  two  successive  outer  loop 
iterations  is  sufficiently  small  -  thus  indicating 
acceptable  convergence  with  respect  to  quadratic 
performance. 


Figure  2;  Outer  (Homotopy)  Loop  ot  OF  Solution  Algoritha 


4.  A  Design  Example  and  Comparison  of  Results 

We  use  the  example  problem  given  by  Enns'  [2] 
to  compare  methods  1-6.  Results  on  this  example 
obtained  by  use  of  methods  1-5  are  discussed  in 
[1] .  Here,  we  augment  these  results  by 
considering  method  6  and  undertake  an  overall 
comparison. 

The  plant  to  be  controlled  in  this  example  is 
a  four-disk  system  and  is  linear,  time- invariant, 
SISO,  neutrally  stable  (with  a  double  pole  at  the 
origin)  and  non-minimum  phase  and  of  eighth  order. 
Numerical  values  of  the  matrices  A.  B.  C.  R  ,  R^. 

Vj,  V ,,  defining  this  problem  are  given  in  Table  1. 
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Ttblt  1:  Dftt*  hathCM  lot  tb*  ImpU  Profclo*  of  Kamo  [2] 


For  each  of  the  methods  1-6,  controllers  of 
different  reduced  orders  (from  seventh  to  second 
order)  were  obtained  for  seven  different  values  of 
Che  disturbance  noise  intensity  parameter,  q^s 

q2  *  0.01,  0.1,  1.0,  10,  100.  1000,  2000 

Thus  each  method  was  used  to  obtain  results  on  42 
different  design  cases. 

Each  of  the  six  methods  was  originally 
devised  according  to  a  wide  variety  of  different 
criterion  for  adequate  performance  of  a  reduced- 
order  compensator  design.  Despite  this  wide 
disparity  among  the  different  aim*  and  motivations 
of  the  several  methods  there  are  at  least  three 
criteria  that  may  be  reasonably  applied  to  judge 
the  success  of  a  reduced— order  design! 
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1.  Closed-loop  stability 

2.  Extant  to  which  tha  raducad-ordar 
compensator  impulse  and  atap  raaponaa 
natch  tha  full-order,  LQG,  coapanaator 

raaponaa 

3.  Tha  cloaad-loop  quadratic  coat 

Howavar,  itaa  3  will  not  ha  conaidarad  ainca  coata 
for  aatboda  1-5  wara  not  providad  (1] .  Tha 
coapariaoo  in  itaa  2  examines  tha  output  y(t)  in 
raaponaa  to  an  input  v(t)  in j act ad  in  tha  loop  a a 
indicated  in  Figure  3. 


*(t|  — > 


«(c)  •  Wait  at«f  at  tapalM 

(*.f.A#)  •  It41-«r4ar  LQO  me  utoti-wot  CfMtur  t*iaa 


figwa  1. 


CfWtn  U  vail  dap  ar  jjpaigg  raap 


First,  Table  2  summarizes  tha  cloaad-loop 
atability  propartiaa  of  all  design  aathoda  in  all 
42  caaaa.  Generally,  it  ia  aeon  that  all  aathoda 
achieva  a  high  rata  of  succaaa  in  achieving 
cloaad-loop  atability  for  tha  largar  Nc  value*  and 

aaall  q^.  On  tha  othar  hand,  aathoda  1-5 

experience  greater  difficultiaa  for  low  valuaa  of 
Nc  and.  particularly,  for  larga  q^.  With  raapect 

to  atability,  the  only  qualitative  diatinction 
among  tha  aathoda  ia  that  method  6  (optimal 
projection)  producea  stable  design  in  all  42 
design  cases. 

The  trend  toward  increasing  difficulty  of  the 
design  with  increasing  disturbance  noiaa  intensity 
is  highlighted  by  Table  3  which  shows  tha 
percentage  of  closed-loop  stable  designs  given  by 
the  different  methoda  for  the  different  values  of 
q2  and  in  total.  That  tha  fraction  of  stable 

designs  declines  with  increasing  q^  ia  to  ba 

expected  since  larger  disturbance  noise  intensity 
increases  Q,  thereby  increasing  observer  gains  to 
produce  faster  observers  that  are  mere  sensitive 
to  order  reduction. 

Overall,  for  this  example  problem,  aathod  4 
exhibits  the  smallest  fraction  of  stable  designs 
(with  24  unstable  designs)  and  does  not  achieve 
any  order  reduction  for  q2  «  100.  1000.  2000.  Of 

the  LQG  reduction  methods  (1-5),  methods  1  and  5 
fare  beat  -  with  only  4  unstable  designs  out  of 
42.  As  noted,  optimal  projection  (method  6) 
yields  stable  designs  in  all  cases. 

To  permit  independent  corroboration  by 
interested  readers  of  the  OP  design  capabilities 
we  give  numerical  values  of  the  compensator  gains 
obtained  by  method  6  for  a  selection  of  the  sore 
difficult  cases*  -  namely: 


*  See  Reference  [13]  for  a  complete  listing  of  all 

42  cases 
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Next,  consider  the  accuracy  with  the  step  and 
impulse  responses  (see  Figure  3)  of  the  various 
reduced-order  compensator  designs  track  the 
corresponding  response  of  the  full-order  LQG 
design.  These  characteristics  exhibit  similar 
trends  as  noted  with  respect  to  closed-loop 
stability.  For  example.  Figure  4  shows  a 
comparison  of  unit  step  responses  for  second-order 
compensator  designs  with  a  small  value  of 
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q2  (=  1.0).  In  this  case,  all  methods  exhibit 

stability  and  reasonable  agreement  with  full  order 
design.  However,  as  the  comparison  of  methods  1-5 
in  Figure  A. a  shows,  methods  1  and  5  show 
distinctly  superior  tracking  accuracy.  For 
clarity,  methods  1  and  5  are  compared  with  method 
6  in  Figure  4.b.  Here  it  is  clear  that  method  5 
is  somewhat  closer  to  the  LQG  response  than  method 
1  while  method  6  is  closest  of  all. 

Similar  trends  are  seen  in  the  comparisons  of 
the  impulse  responses  (for  the  same  design  case) 
in  Figure  5.  Once  again,  of  the  LQG  reduction 
methods  (compared  in  Figure  5. a),  methods  1  and  5 
display  significantly  better  agreement  with  the 
LQG  response.  This  agreement  is  slightly  exceeded 
by  method  6  (Figure  5.b),  but  on  the  whole, 
methods  1.  5  and  6  show  excellent  performance. 

On  the  other  hand,  for  a  fairly  large  value 
of  both  stability  and  agreement  with  LQG 

response  is  degraded  somewhat  for  several  methods. 
Figures  6  and  7  show  comparisons  of  unit  step  and 
impulse  responses  for  the  case  N__  =5,  q^  =  100. 

In  this  case,  only  methods  1,  3,  5  and  6  yield 
stable  designs  and  are  thus  compared.  Of  the  LQG 


reduction  methods,  method  5  exhibits  distinctly 
better  agreement  with  the  LQG  responsea.  Once 
again,  it  is  found  (Figures  6.b  and  7.b)  that 
method  6  somewhat  excels  in  the  accuracy  with 
which  it's  transient  responses  track  the  full- 
order  design. 

Thus,  for  the  42  design  cases  studied  in  this 
example  problem,  methods  1  and  5  damonctrate  good 
success  in  achieving  stable  closed-loop  designs 
while  method  6  achieves  stable  designs  in  all 
cases. 

Also,  in  the  cases  examined,  methods  1  and  5 
offer  good  transient  response  characteristics 
while  method  6  tracks  the  full-order  compensator 
responses  the  closest. 

In  view  of  the  good  performance  exhibited  by 
method  6,  we  present,  in  the  remainder  of  this 
section,  additional  details  on  the  OP  design 
results  and  the  performance  of  the  solution 
algorithm  described  in  Section  3. 
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Figure  6. a  *  Comparison  of  unit  acap  rssponsss  of 

flfth-ordar  compensator*  given  by  estnods  1,  3,  and  5 
with  full-order  design  (large  4,) 
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Figure  t.b  -  Comparison  of  unit  step  responses  of 

flflli-order  compensators  given  by  machoda  5  and  6 
with  full-order  design  (large  q^) 
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Figure  7.0  -  Comparison  of  lcpulse  responses  of 

fifth-order  compensators  given  by  methods  1.  1,  aad  5 
with  full-order  design  (large  q,) 


Figure  7.b  -  Comparison  of  unit  step  responses  of 

fifth-order  roepensators  given  by  methods  5  and  1 
with  full-order  design  (large  q^) 


First,  as  noted,  the  OP  design  philosophy 
focuses  on  the  steady  state  quadratic  performance 
index,  J,  (defined  in  (3))  aa  the  "figure  of 
■erit"  for  a  reduced-order  compensator  design. 
Thus,  we  appropriately  display,  in  Figure  8, 
several  plots  of  the  performance  index  J 
(normalised  by  q^)  versus  compensator  order  for 

all  7  values  of  q^>  Note  that  apart  from  minor 

variations  that  are  likely  dua  to  the  benign 
convergence  tolerance  used  in  the  solution 
algorithm.  J  generally  dacraaaas  monotonically 
with  increasing  Mc>  These  graphs  thus  illustrate 

the  basic  tradeoff  between  performance  and 
controller  complexity. 

Note  that  for  small  q2  (Figure  8. a), 

performance  is  not  much  sffseted  by  order 
reduction.  This  is  to  be  expected  since  small 
disturbance  noise  intensity,  in  this  problem, 
leads  to  lew  observer  gains  and  to  sswll  values 
for  the  terms  involving  in  equations  (10). 

Since  the  Tj_  terms  in  equations  (10)  have  littla 
effect,  the  OP  designs  sra  approximated  by 
balanced  projections  of  tba  LQG  design.  This 
might  also  help  to  explain  tha  relatively 
successful  performance  of  all  msthods  for  small 

V 

For  lsrga  (Figura  8. b)  and  for  very  large 
(Figure  8.c)  values  of  q2»  however,  the 

degradation  of  performanca  with  reduction  in  order 
is  increasingly  staep.  For  axampla.  whila  for 
q2  *  1.0,  the  2nd  order  performanca  ia  only  2.5X 

above  the  LQG  performanca,  for  q2  *  2000,  tba 

second-order  performance  ia  270Z  above  the  LQG 
value.  Thus,  order  reduction  under  large 
disturbance  noise  does  appear  to  ha  a  more 
delicate  matter. 

While  increasing  difficulties  with  q2  srs  not 

clssrly  manifested  in  the  stability  or  transient 
response  properties  of  the  OP  designs,  tbess  sre 
reflected  in  the  computation  required  to  arrive  at 
the  final  designs. 
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To  explain  this  we  now  describe  the  specific 
design  steps  taken  and  the  performance  of  the 
solution  algoritha.  Each  design  case  was  treated 
using  the  OP  solution  algoritha  shown  in  Figures  1 
and  2  and  a  naxiaua  hoaotopy  step  aixa  of  1.0  was 
input.  Furthermore,  for  each  design  ease,  the 
algoritha  was  started  "cold"  -  i.e.,  without  being 
initialised  with  gain  values  obtained  in  previoua 
cases.  On  initial  application  of  the  algoritha, 
the  OP  design  results  presented  here  were  obtained 
after  using  the  numbers  of  inner  loop  iterations 
given  for  each  case  in  Table  4. 
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Note  that  with  A  *  1.0.  the  logic  of  the 
outer  loop  (Figure  2)  implies  a  miniaua  of  two 
inner-loop  iterations.  Inspection  of  the  results 
obtained  in  soae  of  the  benign  cases  suggested  the 
possibility  that  only  one  inner  loop  iteration  was 
needed.  Consequently  we  re-examined  the  cases 
comprising  q2  *  0.01.  0.1,  1.0  and  N,  *  5.  6,  7, 

by  revising  the  outer  loop  logic  to  output  gain 
values  after  only  one  pass  through  the  inner  loop. 
It  vas  found  that  this  produced  acceptable 


accuracy  in  the  cases  q. 


0.01;  N 


5.  6.  7. 


- - — j  —  .... - —  *•  '• 

q2  *  0.1,  Nc  ■  6,  7  and  q^  *  1.0,  N,  =  7.  Thus, 

the  revised  results  are  as  given  in  Table  4*. 
Since  the  gains  are  essentially  unchanged,  the 
design  results  obtained  on  the  first  application 
are  the  ones  presented  here. 


Motor  of  Iu*r-U«f  Itsra(i«M  U«W 
la  Of  Saiacioa  4l|*ricto 
-  tovioto  of  car  rrcuatonclM  of  naaor 
\2  •  0.01,  0.1.  1.0«  N'  •  5,4.7 
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A a  Table  4*  shows,  relatively  fee  iterations 
were  required  in  the  benign,  small  q^,  caaea.  In 

particular,  only  one  inner  loop  iteration  was 
needed  in  Boat  of  the  caaea  coapriaing  q^  *  0.01, 

0.1,  1.0  and  Nfi  *  5,  6,  7.  However,  for  large  q^, 

up  to  10  iterations  were  required.  Thus  it  ia 
clear  that  all  sethods  run  up  against  a 
fundamental  aource  of  difficulty  when  disturbance 
noise  ia  large. 

At  the  time  of  writing,  full  compilation  of 
the  computation  times  required  for  all  methods  on 
the  same  machine  ia  not  available.  All  OP 
calculations  were  performed  on  a  Harris  H800 
minicomputer.  However,  as  a  rough  estimate,  it  ia 
fair  to  say  that  in  the  benign  cases,  the  OP 
computation  ia  comparable  to  the  burden  incurred 
by  methods  1-5.  Por  the  difficult,  large  q^  oases 

the  OP  canputat ional  burden  is.  clearly  in  axcass 
of  methods  1-5  (although  certainly  not  excessive 
from  a  practical  point  of  view) .  However,  it  is 
precisely  in  these  cases  that  the  LQC  reduction 
methods  experience  the  greatest  difficulties  in 
producing  closed-loop  stable  designs.  Thus  a 
meaningful  comparison  of  relative  computational 
burden  in  these  cases  cannot  be  performed. 

Finally  it  should  be  noted  chat  the 
computational  burden  associated  with  OP  for  the 
designs  presented  here  is  also  an  artifact  of  the 
solution  algorithm  depicted  in  Figures  1  and  2  and 
is  not  solely  the  result  of  the  design  aquations 
themselves.  This  algorithm  was  convenient  to  use. 
and  was  the  first  implemented  since  it  requires 
only  standard  LQC  software.  On  the  other  hand, 
the  algorithm  discussed  in  section  3  takes  no 
particular  advantage  of  the  special  structure  of 
the  fundamental  design  equations,  (10).  Its 
principal  draw-back  ia  that  it  involves  the 
iterative  solution  of  four  NxH.  nonlinear  matrix 
equations.  To  remedy  this,  Richter  [12]  has 
developed  a  step-wise  homotopy  algorithm  which 
requires,  at  each  homotopy  step,  the  solution  of 
four  NjtH  linear  equations.  Clearly,  for  small 

N,.  this  offers  the  potential  for  computing  an  OP 

design  with  leas  computational  burden  than  is 
required  for  a  full-order  LOG  design.  It  is 
anticipated  that  the  future  utilization  of 
Richter's  algorithm  will  permit  a  more  accurate 
and  definitive  comparison  between  the 
computational  cost  of  the  LQG-reduction  techniques 
end  the  Optimal  Projection  formulation. 

5 .  Concluding  Remarks 


A  precise  comparison  of  the  computational 
burdens  incurred  by  the  various  methods  is  not 
possible  at  present.  However,  as  a  rough 
comparison,  it  is  fair  to  say  that  the  OP  method 
entailed  comparable  computation  in  the  relatively 
benign  design  cases  and  more  computation  in  the 
difficult  cases.  However  in  this  case  LQG 
reduction  methods  often  produce  unstable  designs. 
Thus  the  OP  method  exhibits  a  tradeoff  between 
computational  burden  and  corresponding  design 
reliability.  Present  developments  are  directed 
toward  implementation  of  advanced  homotopy 
techniques  which  take  particular  advantage  of  the 
structure  of  the  basic  OP  design  equations  to 
markedly  improve  design  computat  '.x  speed. 


Appendix  1 


In  the  following,  numerical  values  of 
the  reduced-order  compensator  gains,  K,  F  and  A^ 

obtained  via  the  OP  solution  algorithm  discussed 
in  section  3  are  given  for  the  design  cases: 


and 


q2  =  2000,  N.  *  2.  3.  4,  5.  6.  7 

N  3  2,  q.  a  0.01,  0.1,  1.0,  10, 

c  ’2 

100.  1000.  2000 


CASE:  gj  •  0.01.  *c  »  2 


0.1357E-01  -0.139* 

*c  * 

c  I  0.39*5  -0.3*30  J 

FT  •  [  0.3*3 IE-02  0.9371E-01] 

K  •  [-0.30*31-01  0.1*21] 


CASE:  -  0.1,  Nc  ■  2 

0. 99131-02  -0.137*1 
0.7650  -0.5093 


In  this  paper,  we  have  used  the  example 
problem  of  Enns  [2]  to  perform  a  computational 
comparison  of  six  methods  for  reduced-order 
dynamic  compensator  design.  Methods  1-5  are  based 
upon  LQG-reduction  procedures  while  method  6  is 
baaed  upon  the  Optimal  Projection  (OP) 
formulation. 


rT  •  [  0. 1695K-02  0.126*1 

t  ■  [-0.37 29E-01  0.2733] 


CASE:  q2  *  l.  •  2 


Of  the  LQG-reduction  methods,  the  methods  of 
Eons  [2]  and  of  Liu  and  Anderson  [1]  exhibited 
particularly  good  stability  and  transient  response 
properties.  However,  in  the  cases  examined,  the 
OP  method  gave  somewhat  better  transient  response 
characteristics  and,  unlike  the  LQG-reduction 
procedures,  produced  closed-loop  stable  designs 
for  all  the  42  design  cases. 


0.7S32E-02  -0.1*12 

A  • 

*  1.269  -0.71*3 

tT  •  [  0.85 16E-03  0.13361 

K  •  [-0.1003  0.5206 
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CASE:  <*„  -  10.  N  *  2 
'2  c 


CASE:  q2  «  100.  Nc  «  2 


0.7474E-02 

0. 19?o" 

A  * 

’  0.2742E-02 

0.4216 

-1.699 

-0.8276 

c 

-2.396 

-0.22748-01 

i1. 

[  0.4S14E-03 

-0.1081] 

M 

[-0. 1538E-03 

0.13031 

K  » 

[-0.1740 

-0.9190 

K  * 

[  0.2351 

0.417E) 

CASE 

:  q.  «  2000. 

N  ■  2 

CASE 

:  q2  •  1000. 

H£  .  2 

^2 

c 

0.1745E-O2 

0.4039 

-0.8376E-O3 

-0.4471 

A  * 

c 

-2.129 

-0.7569E-02 

A  12 
Ac 

2.047 

-0.10951-01 

rT  • 

[-0.6242E-04 

0.7341E-01] 

rT  ■ 

l  0.3272E-04 

-0.7625E-01) 

K  « 

t  0.3753 

0.5049] 

K  * 

(  0.3807 

-0.6.11) 

CASE:  <)2  .  2000 

Mc  .  3 

CASE:  q2  »  2000.  Nc  •  4 

0.2351E-02 

0.1516  0.1492 

0.3225E-02 

-0.3717 

0. 1238E-01 

-0.5735E-01 

A  ■ 
c 

-1.467 

-0.9385E-01  0.6597 

A  * 

2.170 

-0.3860E-02 

-0.3623 

-0.18291-01 

-1.592 

-0.7041  -0.1027E-02 

c 

-0.1140 

0.5365 

-0.2564E-01 

-0.2749 

T 

1.176 

-0.1297 

0.3488 

-0.4452 

r  * 

[  0.5944E-04 

— 0.3619E-01  -0.3990E-01) 

FT  *  [  0.92451-04 

0.6044E-01 

-0.3234E-02 

0.3370E-01] 

K  * 

[-0.5372 

-1.410  0.10331 

(  *  (-0.4871 

0.5626 

0.6852 

2.540J 

A 


c 


CASE:  q2  *  2000.  *c  »  5 


0. 1335E-02 
2.226 

-0. 54181-01 
-0.8042 
6.046 


-0.3220 

-0.3920E-02 

0.6432 

0.2012 

-0.1203E-01 


0.5462E-02 
-0.4659 
-0. 1099E-01 
-0.2791 
1.376 


0.4440E-01 

-0.3941E-01 

0.2117 

-0.2891 

2.351 


-0. 1903 
0.495  IE-02 
-0.4355 
-1.488 
-0.6778E-03 


pT  *  [  0.4018E-04  0.6557E-01  -0.1614E-02  -0.2413E-01  0.1817] 


K  »  1-0.4697  0.5101  0.4346  -1.795  -G.4017E-01] 


CASE:  *2  *  2000,  Nc  *  6 


0.8190E-03 

0.3031  0.8960E-03 

0.7075E-01 

0.3110 

0.2265 

-2.356 

-0.2845E-02  0.5058 

0. 11982-01 

0.3847 E-02 

-0.4306E-01 

-0.7592E-02 

-0.6887  -0.1431E-02 

0.2356 

0.7586 

0.5132 

A. 

■ 

c 

-1.35* 

-0.9398E-01  -0.3875 

-0.1281 

1.265 

-0.M82E-O1 

-S.26E 

-0. 11051-01  -1.861 

-1.709 

0.1190E-02 

0.1426 

-16.17 

-0.4290E-01  -3.152 

-1.545 

-C.3782 

-1.799 

rT 

* 

[  0.27131-04 

-0.7675E-01  -0.2492E-03 

-0.4487E-01 

-0.2702 

-0.5356) 

K 

■ 

[-0.4324 

-0.5140  0.1322 

-1.545 

-0.1364 

-3.524) 

11 


CASS:  H2  •  2000. 


N  »  7 


0.86831-03 

-0.3083 

■O.  1180E-02 

0.6O98E-01 

-0.2844 

-0.2619 

-0.92441-03 

2.329 

-0.28211-02 

0.4921 

-0.17841-01 

0.44681-02 

-0.47801-01 

-0.19501-02 

0. 10411-01 

-0.6794 

-0. 20571-02 

-0.2171 

0.6977 

0.6175 

0.41061-02 

-1.169 

0.1132 

0.3505 

-0.1381 

-1.303 

-0.19291-01 

0.21361-01 

7.960 

-0. 10911-01 

-1.846 

1.851 

0.96871-03 

0.1872 

0.79261-02 

19.90 

-0. 46958-01 

-4.056 

2.398 

-0.4123 

-2.407 

-0.70511-01 

.  0.1906 

-0.46341-02 

-0.38241-01 

0.26801-01 

-0.57931-01 

-0.3975 

-0.12421-01 

t  0.28321-04 

0.74621-01 

0.33621-03 

-0.38011-01 

0.2586 

0.6490 

0.62171-02] 

(-0.4387 

0.5134 

-0.1642 

-1.591 

0.70631-01 

3.924 

0.1567] 
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APPENDIX  G 

Reduced-Order  Control  Design  via  the 
Optimal  Projection  Approach: 

A  Homotopy  Algorithm  for  Global  Optimality 
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ABSTRACT 

The  purpose  of  this  paper  is  to  present  a  homotopy  algorithm  for 
solving  the  Optimal  Projection  Equations.  Questions  of  existence  and 
the  number  of  solutions  will  also  be  examined.  It  will  be  shown  that 
the  number  of  stabilizing  solutions  to  the  given  Optimal  Projection 
Equations  can  be  determined  and  that  all  solutions  can  be  computed  via  a 
homotopic  continuation  from  a  simple  problem.  For  an  important  special 
case,  where  the  number  of  inputs  or  the  number  of  outputs  to  the  system 
is  less  than  or  equal  to  the  dimension  of  the  compensator,  there  is  only 
one  solution  to  the  OPE,  thus  guaranteeing  that  globally  optimum  reduced 
order  controller  can  be  computed. 


1.  Introduction 


Despite  significant  advances  in  the  cost  and  performance  of  digital 
computers  over  the  last  decade,  there  remains  a  need  in  several 
technological  areas  for  low-order,  high-performance  controllers.  In 
particular,  this  paper  is  motivated  by  the  problem  of  vibration 
suppression  in  large  flexible  space  structures.  Such  systems  are 
infinite-dimensional  (distributed  parameter)  in  nature  and  hence  any 
finite-dimensional  controller  is  necessarily  of  reduced  order.  The  need 
for  low-order  controllers  is  further  driven  by  severe  constraints  on 
cost,  weight  and  power  in  space  systems,  not  to  mention  the  restriction 
to  space-qualified  computational  hardware. 

A  wide  variety  of  approaches  have  been  proposed  to  obtaining 
reduced-order  controllers.  A  comparison  of  several  approaches  to 
controller  reduction  is  given  in  [1] .  These  methods  operate  by  first 
designing  a  high-order  LQG  controller  and  then  obtaining  a  suitable  low- 
order  controller  by  means  of  controller  reduction.* 

A  more  direct  approach  to  designing  reduced-order  controllers 
involves  optimizing  the  quadratic  performance  functional  over  the  class 
of  controllers  of  fixed  order.  The  controller  order  may  be  determined 
by  implementation  constraints  or  can  be  varied  for 
performance/ throughput  tradeoff  studies. 


Supported  in  part  by  the  Air  Force  Office  of  Scientific  Research  under 
contract  F49620-86-C-0038. 


An  interesting  reformulation  of  the  parameter  optimization  approach 
was  given  recently  in  [2] .  By  setting  the  gradients  to  zero,  the 
authors  showed  that  the  first  order  necessary  conditions  can  be 
transformed  to  yield  explicit  gain  expressions  for  extremal  fixed-order 
controllers.  An  appealing  aspect  of  this  formulation  is  the  recasting 
of  the  necessary  conditions  in  a  form  which  generalizes  the  classical 
(full-order)  LQG  solution.  Specifically,  instead  of  a  pair  of  separated 
Riccati  equations,  the  necessary  conditions  for  fixed-order  dynamic 
compensation  comprise  a  system  of  two  modified  Riccati  equations  and  two 
modified  Lyapunov  equations  coupled  by  an  oblique  projection  whose  rank 
is  precisely  equal  to  the  order  of  the  compensator.  When  specialized  to 
the  full-order  case,  the  projection  becomes  the  identity,  the  modified 
Lyapunov  equations  drop  out,  and  the  modified  Riccati  equations  simplify 
to  the  classical  Riccati  equations.  Hence  this  approach  appears  to  be  a 
natural  and  fundamental  generalization  of  LQG. 

Regardless  of  hew  appealing  the  optimal  projection  formulation  may 
appear  to  be  and  in  spite  of  the  empirical  advantages  claimed  in  [2-10] , 
its  contribution  is  vacuous  unless  certain  serious  questions  can  be 
resolved.  These  include: 

1.  Under  what  conditions  on  the  problem  data  can  the  optimal 
projection  equations  be  guaranteed  a  priori  to  possess  a 
solution? 

2.  Given  problem  data,  exactly  how  many  solutions  do  the  equations 
possess? 

3.  Of  the  possible  solutions,  what  are  their  stability  properties, 
what  is  their  performance,  and  which  is  the  global  optimum? 

A.  How  can  numerical  algorithms  be  constructed  which  can  be 

guaranteed  to  converge  to  any  desired  solution  especially  the 
global  minimum? 

It  seems  clear  that  any  attempt  to  address  the  above  issues  must 
utilize  mathematical  methods  which  are  global  in  nature.  To  this  end  we 
have  applied  degree  theory  and  associated  homotopic  continuation  methods 
([13-24])  to  analyze  the  solutions  to  the  optimal  projection  equations 
and  to  construct  convergent,  implementable  algorithms  for  their 
computation.  The  purpose  of  this  paper  is  to  report  significant  results 
in  this  regard. 


2.  Homotopic  Continuation  and  Degree  Theory 

2.1  Homotopic  Continuation.  A  homotopic  continuation  method  for 
solving  a  problem  is  to  first  solve  an  easy  "similar"  problem,  and  then 
to  continuously  deform  the  easy  problem  into  the  original  problem  and  to 
follow  the  path  of  solutions  as  the  easy  problem  is  deformed  into  the 
original  problem.  This  is  shown  conceptually  in  Figure  1. 


HL  m  m  •  ,  tan  a  | 


Figure  1 


The  problem  then  becomes  to  follow  the  path  of  solutions  x(t)  of  F(t, 
x(t))=0  from  t=0  to  t=l.  Differentiating  F(t,  x(t))=0  with  respect  to  t 
one  obtains  the  Dauidenko  differential  equation 

Fx(t.  x(t))jf  +  Ft(t.  x(t))  =  0,  or 

—  =  -F^Ct.  x(t))  Ft(t.  x(t)'),  x(0)  =  xQ 

Integration  of  this  initial  value  problem  yields  x(l),  the  solution  to 
F(x)=0. 

Example  1.  Consider  calculating  the  roots  of  a  polynomial 
F(Z)  =  Zn  +  a.  Zn-1  +  a2Zn"2...  +  aQ  «  0. 

Let  the  easy  problem  be  Fq(Z)  =  Zn  -  1=  0  and  deform  Fq  to  F 

F(Z.t)  =  Zn  +  tU.Z11'1  +  a,Z°~2. .  .a  )  -  1  +  t. 

z  n  u 

At  t=0.  FCZ.0)=FQ(Z)  and  F(Z.1)=F(Z). 

The  solutions  Z^t)  which  satisfy  F(Z^,t)=0  are  found  by  differentiating 
F(Z^(t) ,t)=0  to  obtain 

fk  .  .  ‘iC1  *  -  1 _ . 

dt  nZj"1  +  t(a1(n-l)zj"2...an-1) 
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This  differencial  equation  can  be  integrated  from  the  n  initial  values 


V0) 


=  e- 


i27T  k 

n 


to  the  n  solutions  at  t=l. 


2.2  Degree  Theory.  The  main  theoretical  question  which  must  be 
answered  when  using  a  continuation  method  to  solve  a  given  problem  is: 

Is  there  in  fact  a  continuous  path  of  solutions  connecting  F(0,x)=0  with 
F(l,x)=0.  and  if  so,  how  many  paths  are  there? 

Topological  degree  theory  can  be  used  to  answer  this  question. 

N  K 

Definition  1:  Given  a  function  f  mapping  D  in  R  into  V  in  R  a  regular 
value  of  f  is  an  element  p  in  V  such  that  the  NxK  matrix  of  partial 

derivatives  of  f,  f^(x),  has  full  rank  for  each  x  in  f  *(p).  Note 

that  if  N=K  then  f^(x)  having  full  rank  is  equivalent  to 

det(fx(x))^0. 


Definition  2:  Given  a  function  f  mapping  an  open  set  D  in  R*1  with 

_  '  JJ 

boundary  D  into  V  in  R  and  a  point  p  in  V,  the  degree  of  f  for 
domain  D  and  point  p  (written  Deg(f,D,p))  is  defined  and  is  an 

ihteger  if  there. is  no  x  in  the  boundary  D  of  D  such  that  f(x)=p. 
If  p  is  a  regular  point  of  f  then  the  degree  is  the  sum  of  the 
signs  of  the  determinant  of  the  Jacobians  of  f  evaluated  at  all  x 
such  that  f(x)=p.  i.e., 

deg(f.D.p)  =*E  SignC  Det(f  (x  ))) 

*  P 


where  f(kp)  =  P 

The  degree  has  the  following  properties: 

1)  If  deg(f,D,p)  ^  0  then  f(x)=p  has  at  least  one  solution  in  D 

N  N 

2)  Let  f(x,t)  :  R  to  R  for  each  t  in  [0,1]  with  f  continuous.  If  for 

each  t,  f(x,t)=p  has  no  solutions  for  x  in  D,  then  deg(f,D,p)  is 
constant  for  t  in  [0,1]. 

3)  If  f  is  as  in  (2)  and  deg(f  ,D,p)  j*0,  then  at  least  one  solution  of 
f(x,0)=p  connects  with  a  solution  of  f(x,l)=p. 
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Example  2.  Every  polynomial  has  at  least  one  root  (over  the  complex 
numbers) 

Let  f(z)  =  zn  +  a..zn  2  +  ...  a 
l  n 

We  wish  to  show  that  deg(£,D,0)^0. 

Let  f(z.t)  =  zn  +  t(a,zn  i  +  a0zn  2  +  ...  +  a  )  -  1  +  t 

l  z  n 

Let  D=z  such  that  |z|<R.  where  R  is  some  large  number. 


For  z  on  D  (|z|=R)  z11  is  much  larger  than  ta^z“  *  so  f(z,r)^0  for  z 
in  D,  thus  deg(f,D,0)  is  constant  for  t  in  [0,1] . 


n-1 


For  t*0,  f(z,0)=zn  -  1  and  writing  f(r,0)=x  +  iy  we  have  that  the 
solutions  to  f(r, 0, 0)=0  are  r=l,  0=kir/2n  for  k=0.1 . n 

f(z.O)  =  rOc0S^*^  +  1«° 


r  sin(n*0) 


The  Jacobian  of  f  is 


fnr 

r.d  ~  n- 
Lnr 


,n  *cos(n*0),  -nrnsin(n*0)"l 


^inCn*#),  nrncos(n*0)J 


Det(  f  fl)  =  n2  r20  1 

*•17 

The  sign  of  the  Jacobian  is  always  +1,  thus  deg(f ,D,0)=n 


3 .  Homotopy  for  the  Optimal  Projection  Equations 


The  object  is  to  find  P,  Q,  P,  Q,  which  solve 
0  =  AQ  +  QAT  +  -  Q2Q  +  tQSQt*. 

0  =  ATP  +  PA  +  R,  -  PSP  +  rTPSPr  , 

1  1  1 

0  =  (A-SP)Q  +  Q(A-SP)T  +  QSQ  -  rQSQr*. 
0  =  (A-QS)^  +  P(A-QS)  +  PSP  -  t^PSPt^ 
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T  =  G  ,  where 


QP  =  GTMr.  TGT  =  I 


given  2,  2.  R. ,  V. ,  ,  n  A.  To  do  this  let 

il  c. 


A(t)  = 


(1-t)  +  tA 


Rx(t)  =  I(l-t)  +  tRt.  V^t)  =  I(l-t)  +  tVx 


2(c) 


■p 


t)  +  t2 


2  (t) 


=  ‘2o  °“ 

.0  0. 


(1-t)  +  t2 


For  t=0  the  solution  is  easy  to  find.  The  object  is  to  follow  the  path 

A  * 

or  paths  of  solutions  P(t).  Q(t).  P(t).  Q(t)  from  t=0  to  t*l.  Note  that 
if  nc>min{A,n)  -  nu  then  there  is  only  one  solution  at  t=0.  If 


n  <m  {jfc,p}-n  then  there  are 
c  n  u 


^minti.p)  -  n^ 


solutions  at  t=0. 


In  following  these  initial  solutions  from  t=0  to  t=l  there  are 
several  situations  which  could  occur  (see  figure  2) . 


'/  \* 


Figure  2 
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Zc  can  be  shown  using  degree  theory  that  the  situations  shown  in 
dashed  lines  cannot  occur.  That  is,  the  only  solutions  to  the  OPE  at 
t=l  (or  for  0£t<l)  are  those  which  are  continuously  derived  from  the 

solutions  at  t=0. 

Thus  we  have  the  following  result.  Let  nu  denote  the  dimension  of 
the  unstable  subspace  of  A. 

Main  Theorem.  Assume  that  the  plant  is  stabilizable  and 
detectable,  V^>0,  R^>0  and  nu<n£.  Then,  in  the  class  of  nonnegative- 

*  A 

definite  solutions  Q;  P,  Q,  P  with 


rank  Q  =  rank  P  =  rank  QP  =  n^. 


the  optimal  projection  equations  possess  at  most 


(min(n,m,2)-n  \ 

n  _n  /  *  nc  - 


otherwise. 


stabilizing  solutions.  Each  such  solution  is  reachable  via  a  homotopic 
path  with  starting  point  corresponding  to  diagonal  initial  data. 
Furthermore,  if  the  plant  is  stabilizable  by  means  of  an  ncth-order 

dynamic  compensator,  then  there  exists  at  least  one  solution. 

Remark  3.1.  As  shown  in  [26] ,  stabilizing  controllers  of  arbitrary 
reduced  order  may  not  always  exist. 

The  proof  of  the  main  theorem  is  lengthy  and  technically  complex 
and  beyond  the  scope  of  this  paper.  Rather  than  proving  the  main 
theorem  for'the  optimal  projection  equations,  the  full  order  Riccati 
equation  will  be  examined  using  degree  theory  to  obtain  some  well  known 
results  for  the  Riccati  equation.  The  proof  of  the  main  theorem  follows 
the  same  method  as  will  be  used  for  the  full  order  Riccati  equation. 


Full  Riccati  Equation:  ^ 

We  will  now  use  degree  theory  to  examine  the  full  order  Riccati 
equation 


(1)  ATP  +  PA  -  PSP  +  V  =  0 

Where  A  is  an  nxn  matrix  and  S  and  V  are  nxn  symmetric  matrices  with 
V>0.  Denote  |P|  =  max  |P„ |  and  restrict  P  to  be  symmetric.  Define 

F(x,t)  to  map  R^  into  R^(N=n(n+l)/2)  for  each  t  in  [0,1]  by 

(2)  F(P.t)  =  AT(t)P  +  PA(t)  -  PS(t)P  +V(t) 
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where  A(t) .  S(t)  and  V(t)  are  continuous  and  S(t),  V(t)  are  symmetric 
with  V(t)>0  .  Let  D  be  the  set  of  all  P  such  that  |P|<R  and  P>0.  This 

is  an  open  set  in  RN.  The  object  is  to  show  that  Deg(F.D.O)  is  constant 
and  ^  0  for  t  in  [0,1]. 

Lemma  1  -  There  exists  R>0  such  that  for  all  t  in  [0,1],  if  P 
satisfies  (2)  and  (A(t).B(t))  is  stabilizable.  then  |P|<R.  Note  S=BB  . 

Proof:  Suppose  that  the  lemma  is  not  true,  then  there  must  exist 
t^  and  such  that  F(P^,t^)=0  ,  and  |P^|  — >  *o.  We  will  show  that  this 

cannot  occur. 

Let  P±  =  P±/  I  so  |P±  |P±  =  Pi  .  Then 

at (t  J  Pi  +  Pi  ACt^  -  |Pil  P^SCtj)  P£  +  VCt.J/lP.I  =  0 

Write  P.  =  P*  +  P?,  where  P^B  *  0  and  P?  is  in  the  range  of  B.  Then 
lira.  i 

AT(P*  +  P2)  +  (P*  +  P2)  A  -  |P± |  P2  BBTP2  +  V/ I P± I  »  0 

■  1  2 

Since  P^  and  P^  are  bounded  and  A  and  V  are  bounded,  and  |P^|  — >  oo, 

P?  — >  0.  Thus 
a. 

atp*  +  ap!-  IP.  I  p?  bbt  P?  =  0(1/ IP.  |) 
x  x  a.  i  x  x 

T 

Multiplying  on  the  left  by  B  and  on  the  right  by  B  yields 

|Pil  BTP?BBTP?B  =  0(l/|Pil). 

Thus  B^P.BB^P.B  is  bounded,  note  that  this  does  not  imply  that  P.BBTP. 

ii  ii 

is  bounded,  but  it  does  imply  that  P,.  1/2B  is  bounded.  Let  SG  =  limit 
P^^^BB^P^^  and  P  be  limit  P^,  then 


ATP  +  PA  -  P1/2SG  P1/2  =  0. 


Note  also  that  P  the  subspace  spanned  by  P  is  an  A  invariant  subspace, 

★  *  *  * 
i. e.  AP  is  contained  in  P.  Let  A  be  the  operator  A  restricted  to  P. 

*  * 

Since  P  is  an  invariant  subspace,  eigenvalues  of  A  are  eigenvalues  of  A. 

A  and  P  satisfy 
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—1/2  —1/2  * 

Since  P>0  and  P  SGP  >0  we  have  (-A)  is  neutrally  stable. 

Since  PB=0  we  finally  have  that  there  exists  eigenvectors  of  A  say  E, 
such  that  BE=0  and  the  eigenvalue  of  AE  is  non-negative,  or  that  A,B  is 
not  stabilizable.  Thus  |P.|  — >  «o  implies  that  A,B  is  not  stabilizable, 

so  A,B  stabilizable  implies  |P^|  bounded.  QED 

Lemma  2.  F(P,t)^0  for  P  in  5.  Proof:  5  consists  of  all  symmetric 

P  such  that  either  |P|=R  and  P>0  or  |P|<R'and  P>0  with  P  singular. 

Lemma  1  has  shown  that  F(P,t)  ^  0  for  |P|=R.  Suppose  there  exists  a  P 

which  is  singular  with  F(P,t)=0.  Then  there  exists  a  vector  u  such  that 

T  T 

Pu=0  and  u  P=0.  Multiplying  (2)  on  the  left  by  u  and  on  the  right  by  u 

yields  u^V(t)u=0,  which  contradicts  V(t)>0.  Q.E.D. 

We  now  have  that  Deg(F,D,0)=const  for  all  t  in  [0,1]. 

Lemma  3.  Deg(F,D,0)=l.  Proof:  Let  A(0) ,  S(0),  and  V(0)  be 

diagonal.  There  is  only  one  positive  definite  solution  to  (2)  for  this 
A, S,V,  and  this  solution  has  Jacobian  non-zero,  thus  the  Deg(F.D,0)=  +1. 

The  above  analysis  shows  that  there  is  always  at  least  one  solution 
to  F(x,t)=0  and  that  the  solution  set  at  t-0  (consisting  of  just  one- 
point)  connects  with  the  solution  set  at  t=l»  but  the  solution  set  at 
t=l  may  consist  of  more  than  one  point  so  that  the  desired  solution  is 
not  obtained  from  the  homotopy.  We  will  now  show  that  this  is  not  the 
case,  i.e.,  for  the  full  Riccati  equation,  there  is  one  and  only  one 
positive  solution  at  each  point  on  the  homotopy  path. 


Proof:  Let  F:  0°“  — >  t?**  by 

F(P,t)  =  ATP  +  PAT  -  PS(t)F  +  V(t) 

where  A(t),S(t),  and  V(t)  are  as  above  and  P  is  an  nxn  complex  matrix. 

Let  D  be  all  P  such  that  |P|<R,  and  real  part  of  eigenvalues  of  P 
are  positive. 


D  is  open  domain  in  C11*11 .  By  the  same  argument  as  in  the  real 
case,  F(P,t)  ^  0  for  (P|=R.  Also,  it  can  be  shown  that  only  solutions 
to  F(P,t)=0  are  Hermitian,  so  the  eigenvalue  of  P  are  real.  Thus 

F(P,t)=0  and  P  in  D  is  for  |P|=R  (which  cannot  occur)  or  for  P  to  be 
singular  and  F(P,T)=0  which  also  cannot  occur.  Thus  the  deg(F,D,0)= 
const  for  t  in  [0,1],  and  by  using  A(0),V(0),  and  S(0)  diagonal,  we  get 
that  deg(F.D,0)=l. 


We  also  know  that  an  analytic  map  from  (f*  into  G  preserves 
orientation,  that  is  the  Jacobians  always  have  the  same  sign,  thus  we 
have  that  the  number  of  solutions  (at  a  regular  value)  is  equal  to  the 
degree  and  is  always  less  than  or  equal  to  the  degree.  Thus  we  have 
that  there  is  one  and  only  one  complex  solution  to  (2),  and  since  there 
is  at  least  one  real  solution,  there  is  one  and  only  one  real  positive 
solution  to  (2) . 


I 


i 


4.  Algorithm  Description  and  Numerical  Results 

In  a  homotopy  path  following  algorithm  one  follows  the  path  of 
solutions  of  F(n(t),t)  by  integrating  the  initial  value  problem 

=  Fx(x(t))^(x(t)  ,t) ;  x(0)  =  xQ. 

A  A 

For  the  optimal  projections  equations  the  solution  P,  P,  Q,  Q  can 
be  easily  determined  once  r  is  known  so  the  P(t)=P(‘>'(t) ) ,  Q(t)=Q(r(t)) 

a  * 

etc.  Thus  the  derivatives  of  P.  Q,  P,  Q  can  be  written  in  terms  of 
T 

derivatives  of  G  and  I*.  Thus  we  obtain 

vec  ^  T,J  =  ^  M ^  vec  f(I\GT). 

y»  » 

which  gives  2n£n  equation  for  r*  and  G  .  P’,  Q',  P*  and  Q'  are  then 

T' 

calculated  from  I"  and  G  and  finally  T(t+At)  is  updated  by 

r(t+4(t)  =  Itt)  +  +  r’  *  At 

A  A 

and  likewise  for  G,  P,  Q,  P  and  Q. 

Figure  3  summarizes  the  results  reported  in  [1]  for  LQG  reduction 
methods  along  with  results  obtained  using  the  homotopy  method  for 
solving  the  optimal  projection  equations.  Here  q^  is  a  scale  factor  for 

the  plant  disturbance  noise  affecting  controller  authority.  Clearly, 

LQG  reduction  methods  experience  increasing  difficulty  as  authority 
increases,  i.e.,  as  the  terms  become  increasingly  more  important  in 

coupling  the  control  and  reduction  operations. 

One  of  the  main  goals  of  the  development  effort  was  to  extend  the 

range  of  disturbance  intensity  or,  equivalently,  observer  bandwidth,  out 

beyond  q_=2000.  To  this  end,  second-order  (n  =2)  controllers  were 
*  c 

obtained  with  relatively  little  computation  for  q^lO.OOO,  100,000, 
1,000,000.  The  performance  of  these  results  is  summarized  in  Figure  4. 
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Sequential  design  of  decentralized  dynamic  compensators  using  the 
optimal  projection  equations 

DENNIS  S.  BERNSTEINt 

The  optimal  projection  equations  for  quadratically  optimal  centralized  fixed-order 
dynamic  compensation  are  generalized  to  the  case  in  which  the  dynamic  com¬ 
pensator  has,  in  addition,  a  fixed  decentralized  structure.  Under  a  stabilizability 
assumption  for  the  particular  feedback  configuration,  the  resulting  optimality 
conditions  explicitly  characterize  each  subcontroller  in  terms  of  the  plant  and 
remaining  subcontrollers.  This  characterization  associates  an  oblique  projection 
with  each  subcontroller  and  suggests  an  iterative  sequential  design  algorithm.  The 
results  are  applied  to  an  interconnected  flexible  beam  example. 


1.  Introduction 

The  purpose  of  this  note  is  to  consider  the  problem  of  designing  decentralized 
dynamic  feedback  controllers  using  recently  obtained  results  on  quadratically  optimal 
fixed-order  dynamic  compensation  (Hyland  and  Bernstein  1984).  As  in  Bernussou 
and  Titli  (1982),  Looze  et  al.  ( 1978),  and  Singh  ( 1981),  the  overall  approach  is  to  fix  the 
structure  (information  pattern  and  order)  of  the  linear  controller  and  optimize  the 
steady-state  regulation  cost  with  respect  to  the  controller  parameters.  The  underlying 
philosophy  is  that  the  ability  to  carry  out  such  an  optimization  procedure  permits  the 
evaluation  of  a  particular  decentralized  configuration  which  may  be  dictated  by 
implementation  constraints.  If  there  is  some  flexibility  in  designing  the  decentralized 
architecture,  then  these  results  can  be  used  to  evaluate  the  optimal  performance  of 
each  permissible  configuration,  and  hence  to  determine  preferable  structures.  Since 
the  present  paper  is  confined  to  the  question  of  optimal  regulation,  trade-offs  with 
regard  to  robustness  in  the  presence  of  plant  variations  are  not  considered.  Such 
trade-offs  can  be  included,  however,  by  utilizing  the  Stratonovich  multiplicative  white 
noise  approach  developed  by  Bernstein  and  Hyland  (1985). 

To  further  motivate  our  approach,  consider  the  problem  of  controlling  an  nth- 
order  plant  &  by  means  of  a  decentralized  dynamic  compensator  consisting  of 
subcontrollers  and  ^2.  A  straightforward  design  technique  that  immediately 
comes  to  mind  is  that  of  sequential  optimization  (Davison  and  Gesing  1979,  Jamshidi 
1983).  To  begin,  ignore  # 2  and  design  as  a  centralized  controller  for  Next, 
regard  the  closed-loop  system  consisting  of  &  and  “if,  as  an  augmented  system  and 
design  as  a  centralized  controller  for  Now  redesign  to  be  a  centralized 
controller  for  the  augmented  closed-loop  system  composed  of  &  and  #2,  and  so  forth. 
One  difficulty  with  this  scheme,  however,  is  that  of  dimension.  If,  for  example,  one  were 
to  employ  LQG  at  each  step  of  this  algorithm,  then  on  the  first  iteration  would 
have  dimension  n  and  thus  # 2  would  have  dimension  2 n.  On  the  second  iteration,  'if, 
would  require  dimension  3 n  and  If 2  would  have  order  4 n,  and  so  forth.  Such 
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difficulties  can  be  avoided  by  setting  n  =  0,  which  essentially  corresponds  to  static 
output  feedback.  Although  easier  to  implement,  static  output  feedback  lacks  filtering 
abilities  such  as  are  inherent  in  LQG  controllers,  which  are  purely  dynamic  (i.e.  strictly 
proper). 

As  discussed  by  Sandell  et  al.  (1978),  p.  119,  the  explanation  for  this  difficulty  is 
provided  by  the  ‘second-guessing’  phenomenon:  when  LQG  is  used,  each  subcon¬ 
troller  must  consist  of  linear  feedback,  not  only  of  estimates  of  the  plant  states  but  also 
of  estimates  of  the  other  subcontrollers'  estimates.  Hence  the  ‘optimal’  controller  is 
given  by  an  irrational  transfer  function,  i.e.  a  distributed  parameter  (infinite¬ 
dimensional)  system.  Such  controllers,  of  course,  must  be  ruled  out  since  their  design 
and  implementation  (except  in  special  cases)  violate  physical  realizability  (see,  for 
example,  Bernstein  and  Hyland  1986). 

Having  thus  ruled  out  zeroth-order  and  infinite-order  decentralized  controllers, 
we  focus  on  the  problem  of  designing  purely  dynamic  decentralized  compensators. 
Moreover,  by  invoking  the  constraint  of  fixed  subcontroller  order,  we  overcome  the 
second-guessing  phenomenon.  Utilizing  the  parameter  optimization  approach  thus 
leads  to  a  generalization  of  the  result  obtained  by  Hyland  and  Bernstein  (1984)  tor 
centralized  control.  In  brief,  it  was  shown  in  Hyland  and  Bernstein  (1984)  that  the 
unwieldy  first-order  necessary  conditions  for  fixed-order  dynamic  compensation  can 
be  simplified  by  exploiting  the  presence  of  a  previously  unrecognized  oblique 
projection.  The  resulting  optimal  projection  equations,  which  consist  of  a  pair  of 
modified  Riccati  equations  and  a  pair  of  modified  Lyapunov  equations  coupled  by  the 
optimal  projection,  yield  insight  into  the  structure  of  the  optimal  dynamic  com¬ 
pensator  and  emphasize  the  breakdown  of  the  separation  principle  for  reduced-order 
controller  design.  For  example,  the  optimal  compensator  is  the  projection  of  a  full- 
order  dynamic  controller  which  is  generally  different  from  the  LQG  design. 
Furthermore,  this  full-order  controller  and  the  oblique  projection  are  intricately 
related  since  they  are  simultaneously  determined  by  the  coupled  design  equations.  An 
immediate  consequence  is  the  observation  that  stepwise  schemes  employing  either 
model  reduction  followed  by  LQG  or  LQG  followed  by  model  reduction  are  generally 
suboptimal.  For  computational  purposes,  the  optimal  projection  equations  permit  the 
development  of  novel  numerical  methods  which  operate  through  successive  iteration 
of  the  oblique  projection  (Hyland  and  Bernstein  1985).  Such  algorithms  are  thus 
philosophically  and  operationally  distinct  from  gradient  search  methods. 

The  generalization  of  the  optimal  projection  equations  to  the  decentralized  case  is 
straightforward  and  immediate.  In  the  optimization  process  each  subcontroller  is 
viewed  as  a  centralized  controller  for  an  augmented  ‘plant’  consisting  of  the  actual 
plant  and  all  other  subcontrollers.  It  need  only  be  observed  that  the  necessary 
conditions  for  optimality  for  the  decentralized  problem  must  consist  of  the  collection 
of  necessary  conditions  obtained  by  optimizing  over  each  subcontroller  separately 
while  keeping  the  other  subcontrollers  fixed.  More  precisely,  this  statement  corre¬ 
sponds  to  the  fact  that  setting  the  Frechet  derivative  to  zero  is  equivalent  to  setting  the 
individual  partial  derivatives  to  zero.  Hence  it  is  not  surprising  that  the  optimal 
projection  equations  for  the  decentralized  problem  involve  multiple  oblique  projec¬ 
tions,  one  associated  with  each  subcontroller.  Furthermore,  each  subcontroller 
incorporates  an  internal  model  (in  the  sense  of  an  oblique  projection  of  full-order 
dynamics)  not  only  of  the  plant  but  also  of  all  other  subcontrollers.  The  structure  of 
the  equations  suggests  a  sequential  design  algorithm  such  as  that  proposed  in  this 
work. 
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The  simplicity  with  which  this  result  is  obtained  should  not  belie  its  relevance  to 
the  decentralized  control  problem.  Specifically,  our  approach  is  distinct  from  sub- 
system-decomposition  techniques  (Ikeda  and  Siljak  1980,  1981,  Ikeda  et  al.  1981, 
1984,  Lindner  1985,  Linnemann  1984,  Ozguner  1979,  Ramakrishna  and  Viswanadham 
1982,  Saeks  1979,  Sezer  and  Huseyin  1984,  Silkak  1978,  1983)  and  model-reduction 
methods  since  the  optimal  projection  equations  retain  the  full,  interconnected 
plant  at  all  times.  For  the  proposed  algorithm,  decomposition  techniques  which 
exploit  subsystem-interconnection  data  can  play  a  role  by  providing  a  starting  point 
for  subsequent  iterative  refinement  and  optimization.  Decomposition  methods  may 
also  play  a  role  when  very  high  dimensionality  precludes  direct  solution  of  the  optimal 
projection  equations.  These  are  areas  for  future  research. 

With  regard  to  the  role  of  the  oblique  projection,  it  should  be  noted  that  such 
transformations  do  not,  in  general,  preserve  plant  characteristics  such  as  poles,  zeros, 
subspaces,  etc.  Indeed,  since  the  oblique  projection  arises  as  a  consequence  of 
optimality,  approaches  that  seek  to  retain  system  invariants  (e.g.  Uskokovic  and 
Medanic  1985)  are  generally  suboptimal.  In  addition,  the  complex  coupling  among 
the  plant  and  subcontrollers  via  multiple  oblique  projections  provides  an  additional 
measure  for  evaluating  the  suboptimality  of  the  methods  proposed. 

The  plan  of  the  paper  is  as  follows.  The  fixed-structure  decentralized  dynamic- 
compensation  problem  is  stated  in  §  2  along  with  the  generalization  of  the  optimal 
projection  equations.  In  §  3  we  propose  a  sequential  design  algorithm  for  solving  these 
equations  and  state  conditions  under  which  convergence  is  guaranteed.  Finally,  in  §  4 
the  algorithm  is  applied  to  the  8th-order  model  of  a  pair  of  simply  supported  beams 
connected  by  a  spring.  For  this  example,  we  obtain  a  two-channel  decentralized 
design  which  is  4th-order  in  each  channel  and  compare  its  performance  with  the  (8th- 
order)  centralized  LQG  design. 


2.  Problem  statement  and  main  theorem 

Given  the  controlled  system 

x(t)  =  Ax(t)  +  £  B,u,(t)  +  w0(r) 

1*1 

yM  =  C|X(t)  +  Wj(t),  i  =  l, ...,  p 
design  a  fixed-structure  decentralized  dynamic  compensator 

=  ^ci’Xc.U)  4"  Bciy((t),  i  1, ...,  p 
u,(f)  =  Ccjxci(r),  i  =  1, ...,  p 


(2.1) 

(2.2) 

(2.3) 

(2.4) 


which  minimizes  the  steady-state  performance  criterion 


ccl,  •••>  Ac 


Qp 


4  lim  E  x(t)TR0x(t)+  t  Uft)7 RiUi(t)  (2.5) 

t  -*  x  i  =  1 


where,  for  i  = 


A,  B,,  Ct,  Aci,  Bci,  Cci,  R0  and  R,  are  matrices  of  appropnate  dimension  with  R0 
(symmetric)  non-negative  definite  and  Rt  (symmetric)  positive  definite;  w0  is  white 
disturbance  noise  with  n  x  n  non-negative-definite  intensity  V0,  and  w,  is  white 
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observation  noise  with  /,  x  1,  positive-definite  intensity  Vt,  where  w0,  w, , wp  are 
mutually  uncorrelated  and  have  zero  mean.  E  denotes  expectation  and  superscript  T 
indicates  transpose. 

To  guarantee  that  J  is  finite  and  independent  of  initial  conditions  we  restrict  our 
attention  to  the  set  of  admissible  stabilizing  compensators 

s/  4  {Mcl,  Bci,  Ccl, ...,  Aep,  Bcp,  Ccp):  A  is  asymptotically  stable} 
where  the  closed-loop  dynamics  matrix  A  is  given  by 


where 

C, 

54  [B,  ...  B,],  £4  : 

C, 

Ac  4  block -diagonal  (4C,, ...,  Acp) 

Bc  4  block -diagonal  (Bcl . Bcp) 

Cc  4  block -diagonal  (Ccl . Ccp) 

^For  possibly  non-square  matrices  S, ,  S2,  block -diagonal  (S, ,  S2)  denotes  the 

matrix 

It  is  possible  that  for  certain  decentralized  structures  the  system  is  not  stabilizable, 
i.e.  s/  is  empty  (Wang  and  Davison  1973,  Seraji  1982,  Sezer  and  Siljak  1981).  Our 
approach,  however,  is  to  assume  that  si  is  not  empty  and  characterize  the  optimal 
decentralized  controller  over  the  stabilizing  class.  Since  the  value  of  J  is  independent 
of  the  internal  realization  of  each  subcompensator,  without  loss  of  generality  we  can 
further  restrict  our  attention  to 

•s/+  -  {(/lcl,  Bcl,  Ctl . Acp,  Bcp,  Ccp)  e  si\  (4ci,  Bc<)  is  controllable  and 

(Ccj,  Aci)  is  observable,  i  =  1, ...,  p} 

The  following  lemma  is  an  immediate  consequence  of  Theorem  6.2.5,  p.  123  of  Rao 
and  Mitra  (1971).  Let  J,  denote  the  r  x  r  identity  matrix. 

Lemma  2.1 

Suppose  Q,  P  e  R,K<  are  non-negative  definite  and  rank  QP  =  r.  Then  there  exist 
G,  T  e  W  *  *  and  invertible  MeR'xr  such  that 

(5B  =  GTMr  (2.6) 

TGT  =  Ir  (2.7) 

For  convenience  in  stating  the  main  theorem,  call  (G,  M,  T)  satisfying  (2.6),  (2.7)  a 


*u 
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1 

projective  factorization  of  QP.  Such  a  factorization  is  unique  modulo  an  arbitrary 
change  in  basis  in  Rr,  which  corresponds  to  nothing  more  than  a  change  of  basis  for 

the  internal  representation  of  the  compensator  (or  subcompensators  in 
context). 

the  present 

We  shall  also  require  the  following  notation.  Let  At  denote  A  with  the  rows  and 
columns  containing  Aci  deleted.  Similarly,  let  Rt  be  obtained  by  deleting  the  rows  and 

J 

columns  corresponding  to  Cj,/?jCcl  in  the  matrix 

R  £  block-diagonal  [R0,  Cj,  Rx  Ccl , ...,  C]pRpCcp) 

And  furthermore,  P,  is  obtained  by  deleting  the  rows  and  columns  containing  Bci  KjBj, 

~ 

in 

i 

V  ^  block -diagonal  (F0,  Bci  V'jBj,, ....  BcpVpBj„) 

Also  define 

5,4 L  Bi  1  Ci~iCi 

k. 

• 

where  0r>1  denotes  the  r  x  s  zero  matrix.  Note  that  A,,  Bt,  Ct,  Rt  and  P,  essentially 
represent  the  closed-loop  system  minus  the  ith  subcontroller  as  controlled  by  the 

latter.  Finally,  define 

■ 

l^BiRf'Bj,  t^CjVr'Ci 

« 

and,  for  t  e  Rr  x  r,  let 

Tl  */r-  f 

Main  theorem 

■ 

Suppose  (Aci,Bcl,CCI,...,Acp,Bcp,Ccp)es/+  solves  the  steady-state  fixed- 

structure  decentralized  dynamic-compensation  problem.  Then  for  i  =  1 

...,p  there 

exist  (n  +  nc  — ncj)  x(n  +  nc  —  nci)  non-negative-definite  matrices  Qh  Ph 
such  that  Aci ,  Bci  and  Ccf  are  given  by 

(5,  and  Pt 

-4C.  *  rf(Ai  -  Q,li  -  T.,Pi)Gj 

(2.8) 

B'^r&Cjv,-1 

(2.9) 

Cc,  =  -R-'BJP'G] 

(2.10) 

for  some  projective  factorization  Gh  M„  I",  of  &  P„  and  such  that,  with  t( 
following  conditions  are  satisfied: 

=  Gj  rf,  the 

0  =  -4j  Qi  +  QiAj  +  P]  -  QiT-iQi  +  *i±Qt£iQi*J± 

(2.11) 

0  =  AjP,  +  PjA,  +  Rt-  P.IjF,  +  zJ1PiI.iPiT,1 

(2.12) 

0  =  (A,  -  X.P.tC.  +  &K  -  I iPf  +  QXiQi  -  t,x QAQfiL 

(2.13) 

> 

0  =  (At  -  Qi2i)rPi  +  Pf(/4,  -  Q.I.)  +  Pi2iPi  -  tIP^PSu 

(2.14) 

rank  =  rank  P(  =  rank  (J iPi  =  nci 

(2.15) 

j 

j 
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Remark  2.1 

Because  of  (2.7)  the  matrix  t,  is  idempotent,  i.e.  xf  =  tf.  This  projection  corre¬ 
sponding  to  the  ith  subcontroller  is  an  oblique  projection  (as  opposed  to  an 
orthogonal  projection)  since  it  is  not  necessarily  symmetric.  Furthermore,  x(  is  given  in 
closed  form  by 

T,  =  &*,(&*,)* 

where  (  )'  denotes  the  (Drazin)  group  generalized  inverse  (see,  for  example,  Campbell  i 

and  Meyer,  1979,  p.  124). 

3.  Proposed  algorithm 

Sequential  design  algorithm 

Step  1.  Choose  a  starting  point  consisting  of  initial  subcontroller  designs; 

Step  2.  For  a  sequence  {ik}®«i,  where  ike  {1, ...,  p},  k=  1,2,...,  redesign  subcon¬ 
troller  ik  as  an  optimal  fixed-order  centralized  controller  for  the  plant  and 
remaining  subcontrollers; 

Step  3.  Compute  the  cost  Jk  of  the  current  design  and  check  Jk-Jk_i  for 
convergence. 

Note  that  the  first  two  steps  of  the  algorithm  consist  of  (i)  bringing  suboptimal 
subcontrollers  ‘on  line’  and  (ii)  iteratively  refining  each  subcontroller.  As  discussed  in 
§  1,  the  choice  of  a  starting  design  for  Step  1  can  be  obtained  by  a  variety  of  existing 
methods  such  as  subsystem  decomposition.  As  for  subcontroller  refinement,  note  that 
each  subcontroller  redesign  procedure  is  equivalent  to  replacing  a  suboptimal 
subcontroller  with  a  subcontroller  which  is  optimal  with  respect  to  the  plant  and 
remaining  subcontrollers. 

Proposition  3.1 

For  a  given  starting  design  and  redesign  sequence  {i, }  ®= ,  suppose  that  the  optimal 
projection  equations  can  be  solved  for  each  k  to  yield  the  global  minimum.  Then 
i  is  monotonically  non-increasing  and  hence  convergent. 

Determining  both  a  suitable  starting  point  and  redesign  sequence  for  solvability 
and  attaining  the  decentralized  global  minimum  remain  areas  for  future  research. 

With  regard  to  algorithms  for  solving  the  optimal  projection  equations  for  each 
subcontroller  redesign  procedure,  details  of  proposed  algorithms  can  be  found  in  the 
works  of  Hyland  (1983,  1984)  and  Hyland  and  Bernstein  (1985). 

4.  Application  to  interconnected  flexible  beams 

To  demonstrate  the  applicability  of  the  main  theorem  and  the  sequential  design 
algorithm,  we  consider  a  pair  of  simply  supported  Euler- Bernoulli  flexible  beams 
interconnected  by  a  spring  (see  the  Figure).  Each  beam  possesses  one  rate  sensor  and 
one  force  actuator.  Retaining  two  vibrational  modes  in  each  beam,  we  obtain  the  8th- 
order  interconnected  model 
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where 

0  <ou  0 

—  cou  —  (fc/a>u)(sin  nc.)2  -2£,c oti  -(<c/tu2,)(sin  7tc,)(sin  27tC() 

0  0  0 

-(fc/ft},,)(sin  7tc,)(sin  2n c,)  0  -  w2i  -  (fc/ai2l)(sin  2 /tc,)2 

0  0  0  0 

(k/a»u)(sin  rtc,)( sin  rcc;)  0  (fc/aj?i)(sin  7tc,)(sin  2ncj)  0 

0  0  0  0 

(fc/a>u)(sin  7tCj)(sin  2nct)  0  (fc/a>2,)(sin  2ncf)(sin  Inc j)  0 

0 

—  sin  naj 

Bi(  =  ,  C.j  =  [0  sin  nSi  0  sin  27tsJ 

0 

-  sin  2nat 

a,  =  di/Li,  s,  =  sf Lit  c,  =  c./L,- 

In  the  above  definitions,  fe  is  the  spring  constant,  a>;-,  is  the  ;'th  modal  frequency  of  the 
ith  beam,  is  the  damping  ratio  of  the  ith  beam,  Lt  is  the  length  of  the  ith  beam,  and 
dj,  Sj  and  cf  are,  respectively,  the  actuator,  sensor  and  spring-connection  coordinates 
as  measured  from  the  left  in  the  Figure.  The  chosen  values  are 
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k  =  10 

a>u  =  1,  <x>2i  =  4,  £,  =  0-005,  L,  =  1,  /  =  1,2 
d,  =  03,  s,=065,  Cj=0-6 
<j2  =  08,  s2  =  02,  c2  =  04 

In  addition,  weighting  and  intensity  matrices  are  chosen  to  be 


R{  =  block -diagonal 
R2  =  /?3  =  01/2 
V0  =  block -diagonal 
K  =  ^2  =  01/2 


(V 


\L°  */«> 


°  -in  °  in  °  If 
»  »  » 
to,jJ  [_0  l/(i>2i J  0  l/w12J  0 


([:  :n:  :]■[: :}[: :]) 


o 

l/co22 


For  this  problem  the  open-loop  cost  was  evaluated  and  the  centralized  8th-order 
LQG  design  was  obtained  to  provide  a  baseline.  To  provide  a  starting  point  for  the 
sequential  design  algorithm,  a  pair  of  4th-order  LQG  controllers  were  designed  for 
each  beam  separately  ignoring  the  interconnection,  i.e.  setting  k  =  0.  The  optimal 
projection  equations  were  then  utilized  to  iteratively  refine  each  subcontroller.  The 
results  are  summarized  in  the  Table. 


Design 

Cost 

Open  loop 

163  5 

Centralized  LQG 

nc  =  8 

19-99 

Suboptimal  decentralized 

"cl  ="cJ=4 

59-43 

Redesign  subcontroller  2 

2819 

Redesign  subcontroller  1 

23-29 

Redesign  subcontroller  2 

23-04 

Redesign  subcontroller  1 

22-25 

Redesign  subcontroller  2 

21-94 

Redesign  subcontroller  1 

21-86 

Redesign  subcontroller  2 

21-81 

Redesign  subcontroller  1 

21-79 
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Abstract 

Sufficient  conditions  are  developed  for  designing  robust 
decentralized  static  output  feedback  controllers.  The  approach  involves 
deriving  necessary  conditions  for  minimizing  a  bound  on  closed-loop 
performance  over  a  specified  range  of  uncertain  parameters.  The  effect  of 
plant  parameter  variations  on  the  closed-loop  covariance  is  overbounded  by 
means  of  a  modified  Lyapunov  equation  whose  solutions  are  guaranteed  to 
provide  robust  stability  and  performance. 
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Introduction 


Because  of  implementation  constraints,  cost,  and  reliability 
considerations,  a  decentralized  controller  architecture  is  often  required 
for  controlling  large  scale  systems.  Furthermore,  such  controllers  must  be 
robust  to  variations  in  plant  parameters.  The  present  paper  addresses  both 
of  these  concerns  within  the  context  of  a  robust  decentralized  design  theory 
for  continuous-time  static  controllers. 


The  approach  to  controller  design  considered  herein  involves 
optimizing  closed-loop  performance  with  respect  to  the  feedback  gains.  This 
approach  to  output  feedback  was  studied  for  centralized  controllers  in 

[8.9]  and  for  decentralized  controllers  in  [10].  An  interesting  feature  of 

[9.10]  is  the  recognition  of  an  oblique  projection  (idempotent  matrix)  which 
allows  the  necessary  conditions  to  be  written  in  terms  of  a  modified  Riccati 
equation.  When  the  problem  is  specialized  to  full-state  feedback,  the 
projection  becomes  the  identity  and  the  modified  Riccati  equation  coincides 
with  the  standard  Riccati  equation  of  LQR  theory.  It  should  be  pointed  out 
that  this  oblique  projection  is  distinct  from  the  oblique  projection  arising 
in  dynamic  compensation  ([7]).  A  unified  treatment  of  the  static/dynamic 
(nonstrictly  proper)  centralized  control  problem  involving  both  projections 
is  given  in  [2]  . 


The  present  paper  goes  beyond  earlier  work  by  deriving  sufficient 
conditions  for  robust  stability  and  performance  with  respect  to  variations 
in  the  plant  parameters.  Although  plant  disturbances  are  represented  in  the 
usual  stochastic  manner  by  means  of  additive  white  noise,  uncertainty  in  the 
plant  dynamics  is  modeled  deterministically  by  means  of  constant  structured 

parameter  variations  within  bounded  sets.  Thus,  for  example,  the  dynamics 

P 


matrix  A  is  replaced  by  A  +  y^q^A^ ,  where  q^  is  a  constant  uncertain 

k=l 

parameter  assumed  only  to  lie  within  the  interval  [-0^,0:^]  but  otherwise 
unknown,  and  A^  is  a  fixed  matrix  denoting  the  structure  of  the  uncertain 
parameter  q,^  as  it  appears  in  the  nominal  dynamics  matrix  A.  The  system 
performance  is  defined  to  be  the  worst-case  value  over  the  parameter 
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uncertainties  of  a  quadratic  criterion  averaged  over  the  disturbance 
statistics. 


Since  the  closed-loop  performance  can  be  written  in  terms  of  the 

second-moment  matrix,  a  performance  bound  over  the  class  of  uncertain 

parameters  can  be  obtained  by  bounding  the  state  covariance.  The  key  to 

bounding  the  state  covariance  is  to  replace  the  usual  Lyapunov  equation  for 

the  second-moment  matrix  by  a  modified  Lyapunov  equation.  In  the  present 

paper  the  modified  Lyapunov  equation  is  constructed  by  adding  two  additional 

terms.  The  first  term  corresponds  to  a  uniform  right  shift  of  the  open-loop 

dynamics.  As  is  well  known  ([1]),  such  a  shift  may  arise  from  an 

exponential  performance  weighting  and  leads  to  a  uniform  stability  margin 

for  the  closed-loop  system.  In  order  to  obtain  robustness  with  respect  to 

specified  structured  parameter  variations,  however,  an  additional  term  of 
T 

the  form  A^QA^  is  required.  Such  terms  arise  naturally  in  systems  with 
multiplicative  white  noise;  see  [A]  and  the  references  therein  for  further 
details.  The  exponential  cost  weighting  and  multiplicative  noise 
interpretations  for  the  uncertainty  bound  have  no  bearing  in  the  present 
paper,  however,  since  parameter  variations  are  modeled  deterministically  as 
constant  variations  within  bounded  sets. 


Having  bounded  the  state  covariance  over  the  class  of  parameter 
uncertainties,  the  performance  can  thus  be  bounded  in  terms  of  the  solution 
of  the  modified  Lyapunov  equation.  The  performance  bound  can  be  viewed  as 
an  auxiliary  cost  and  thus  leads  to  the  Auxiliary  Minimization  Problem: 
Minimize  the  performance  bound  while  satisfying  the  modified  Lyapunov 
equation.  The  nice  feature  of  the  auxiliary  problem  is  that  necessary 
conditions  for  optimality  of  the  performance  bound  now  serve  as  sufficient 
conditions  for  robust  performance  in  the  original  problem.  Thus  our 
approach  seeks  to  rectify  one  of  the  principal  drawbacks  of  necessity 
theory,  namely,  guarantees  of  stability  and  performance.  Furthermore,  it 
should  be  noted  that  if  numerical  solution  of  the  optimality  conditions 
yields  a  local  extremal  which  is  not  the  global  optimum,  then  robust 
stability  and  performance  are  still  guaranteed,  although  the  performance  of 
the  extremal  may  not  be  as  good  as  the  performance  provided  by  the  global 
minimum.  Philosophically,  the  overall  approach  of  control  design  for  a 
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performance  bound  is  related  to  guaranteed  cost  control  (  [6] ) .  We  note, 
however,  that  the  bound  utilized  in  [6]  is  nondif ferentiable,  which 
precludes  the  approach  of  the  present  paper. 


A  further  extension  of  previous  approaches  considered  in  the 
present  paper  involves  the  types  of  feedback  loops  considered. 

Specifically,  the  usual  approach  to  static  output  feedback  involves  nonnoisy 
measurements  and  weighted  controls,  while  the  dual  problem  involves  feeding 
back  noisy  measurements  to  unweighted  controls.  This  situation  leads  to  an 
additional  projection  ([2])  which  is  dual  to  the  projection  discussed  in 
[9,10].  The  inclusion  of  the  dual  case  now  leads  to  a  pair  of  modified 
Riccati  equations  coupled  by  both  the  uncertainty  bounds  and  the  oblique 
projections . 

In  addition  to  the  two  types  of  loops  discussed  above,  one  may 
wish  to  consider  the  two  remaining  cases,  namely,  feeding  back  noisy 
measurements  to  weighted  controls  and  feeding  back  nonnoisy  measurements  to 
unweighted  controls.  It  is  easy  to  show,  however,  that  the  former  case 
leads  to  an  undefined  (i.e.,  infinite)  value  for  the  performance  while  the 
latter  case  is  highly  singular  and  fails  to  yield  explicit  gain  expressions. 

Finally,  the  scope  of  the  present  paper  is  limited  to  a  rigorous 
elucidation  of  sufficient  conditions  for  robust  decentralized  output 
feedback.  Numerical  solution  of  these  equations  can  be  carried  out  by 
extending  available  algorithms  for  centralized  output  feedback.  Numerical 
algorithms  for  solving  a  single  modified  Riccati  equation  in  the  absence  of 
uncertainty  bounds  are  discussed  in  [10] . 


2.  Notation  and  Definitions 


R,  E 


rxs 


(  ) 


T 


real  numbers,  rxs  real  numbers,  R^^,  expectation 
rxr  identity,  transpose 
Kronecker  sum,  Kronecker  product  ([5]) 
rxr  symmetric  matrices 


N 


Z1  1Z2 

Z1  <  Z2 


asymptotically 
stable  matrix 


rxr  symmetric  nonnegative-definite  matrices 
rxr  symmetric  positive-definite  matrices 

Z2_Z1*  ^  zi»  z2€  |r 


VVI  • 


Zl*  Z2€  i 


matrix  with  eigenvalues  in  open  left  half  plane 


n,  r,  s,  p 
i.  j.  k 


m. .  I  . 

i  i 

m.,  i  . 
3  3 


positive  integers 

indices,  i=l . .  j=l,...,s,  k=l, 

positive  integers,  i=l,...,r 
positive  integers,  j=l,...,s 
n-dimensional  vector 


V  yi 


uj  *  yj 


Aq, 

a. 


m.,  i .-dimensional  vectors,  i=l . r 

i  i 

A 

nu,  i ^-dimensional  vectors,  j=l . s 


A.  4A 

nxn  matrices 

B.,  AB.i  C. 

ill 

A 

nxnu  matrices;  i^xn 

matrices,  i=l 

V  cr  4ci 

nxn .  matrices;  i.xn 

3  3 

matrices,  j=l 

B.. 

nxn  matrices,  k=l,...| 

•  P 

nxm.  matrices,  i=l, . . 

,.rf  k=l . ■ 

ik 

Cjk 

X.xn  matrices,  i=l, . . 

. .  s.  k=l . ' 

3 

D  . 

Cl 

m.xi.  matrices,  i=l, . 

ii 

•  •  »r 

E  . 

CJ 

m.xi.  matrices,  i=l,. 
3  J 

•  »  i  s 

a 

positive  number 

A  +  ^I 
2  n 

positive  number,  k=l, 
2 

o^/a,  k=l . . 


real  number,  k=l,. 
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w  (t) ,  w  .  (t) 
o  3 


V  .  V. 
o  3 


R  .  R. 

o  i 


n— dimensional,  l> .-dimensional  white  noise,  j-l,...»s 

_ 

intensities  of  wq,  w  ^ ;  Vq  €  €  P  ,  j-l»  •  •  •  »s 

n xjl.  cross  intensity  of  w  ,  w.,  j=l,...,s 
3  o  J 

mi 

state  and  control  weightings;  R^  £  N11 ,  R^€  P  , 

1=1 ••«!»? 

-IT 

nxm.  cross  weighting;  R  ~R  .R.  R  .  >  0t  i=l,...,r 
i  o  oi  i  oi  - 


A  +  Vb.D  .C.  +  V B.E  .C.,  A  +  ^1 
LmJ  i  ci  x  L—d  j  cj  3  2  i 

i=l  j=l 

r  s 

Ah  +  Y54B.D  .C.  +  Y' B  .E  .AC. 

x  Cl  i  L-i  3  cj  j 

i=l  j=l 


w  (t)  +  V^B  .E  .w  .  (t) 
o  Li  ]  q  j 
j=l 


R  +  VtR  .D  C.  +  cTdT.RT.  +  CV.R.D  .C. 
o  oi  ci  i  i  ci  oi  x  cx  i  ex  x 


.D  .CJ 


V  +  V[v  .ET.bT  +  B.E  .VT.  +  B.E  .V  eJ .bT] 
o  Lj  oj  cj  j  ]  cj  oj  2  cj  j  cj  j 


For  arbitrary  nxn  Q,  P  define: 


1  Ri  *  EVW’  Pai  4  BIP  *  Roi  *  £V>lkPV  i=I . r’ 

k=l  k=l 


4  vj +  2>kVcJk-  4  QCj +  v»j -  Ewv  j-1 . s- 
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3 .  Robust  Stability  and  Performance  Problem 


In  this  section  we  state  the  Robust  Stability  and  Performance 

Problem  along  with  related  notation  for  later  use.  Let 
nxm  nxm  X.xn  X  xn 

U  C  R1^11  x  R  1  x  ...  x  R  r  x  R  1  x  . . .  x  R  S  denote  the  set  of 

uncertain  perturbations  &A.AB  , . . .  ,AB  ,AC  , . . .  ,AC  )  of  the  nominal  system 

1  IT  X  S 

ma trices  A.5~t..«.B  .C-i«««|C  . 

l  r  l  s 

Robust  Stability  and  Performance  Problem.  Determine 

(D  D  ,E . E  )  such  that  the  closed-loop  system  consisting  of  the 

cl  cr  cl  cs 

nth-order  controlled  and  disturbed  plant 


x  (t)  =  (A+AA)x(t)  +  J^(BiHABjui(t)  +  ]^BjUj (t)  +Wo(t)*  *  6  (3*1} 

j=l 


i=l 


nonnoisy  and  noisy  measurements 


y . (t)  =  C.x(t) .  i=l, . . .,r, 
i  i 


(3.2) 


y .  (t)  =  (C.+AC.)x(t)  +w.(t),  j=l . .  (3.3) 

J  J  J  3 


and  static  output  feedback  controller 


u.(t)  =D  y.(t),  i=l,....r, 

l  cr  i 


(3.4) 


u.(t)  =  E  .y.(t),  j  =  l . . 

J  cj  J 


(3.5) 


is  asymptotically  stable  for  all  variations  in  U  and  the  performance  criterion 


J  (D 


cl” 


»D  , E  i  • 
cr  cl 


..E  )  i 

cs 


T 

sup  lim  sup  E[x  (t)R  x(t) 
U  t--°o  _ 


r 


+  2^xT(t) 

i=l 


R  .u.(t) 

Ol  1 


+  y*  uT(t)R.u.  (t)] 

i—i  1  11 

i=l 


(3.6) 


is  minimized. 
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For  each  controller  (D  ,,..., D  ,E . E  )  and  variation  in  U, 

cl  cr  cl  cs 

the  closed-loop  system  (3 . 1 ) — (3 .5 )  is  given  by 


x(t)  =  (A-hdA)x(t)  +w(t),  t€[0,«o),  (3.7) 

where  w(t)  is  white  noise  with  intensity  V  £  tf*. 

Remark  3.1.  In  the  case  4A,4B^,4C .  =  0  it  is  well  known  that 
stabilizability  is  related  to  the  existence  of  fixed  modes  ( [11] ) .  When 
plant  uncertainties  are  present  the  problem  is,  of  course,  far  more  complex. 
In  the  present  paper  sufficient  conditions  for  robust  stability  are  obtained 
as  a  consequence  of  the  existence  of  robust  performance  bounds. 

Remark  3.2.  Note  that  the  controller  architecture  is  quite  general 
in  that  it  includes  two  distinctly  different  types  of  decentralized  loops. 
The  first  type,  indexed  by  i=l,...,r,  involves  feeding  back  nonnoisy 
measurements  to  weighted  controls.  This  is  the  standard  setting  in  the 
optimal  output-feedback  literature  ([8-10]).  In  addition,  we  include  the 

dual  situation,  indexed  by  j=l . .  which  involves  feeding  back  noisy 

measurements  to  unweighted  controls.  The  case  in  which  only  one  type  of 
loop  is  present  can  be  formally  recovered  from  our  results  by  ignoring 

A  A 

and  or  B.  and  C.  as  required.  As  noted  in  Section  1,  noisy 
measurements  cannot  be  fed  back  to  weighted  controls  via  static  control, 
while  feeding  back  nonnoisy  measurements  to  unweighted  controls  is  a  highly 
singular  problem. 

Remark  3.3.  Note  that  the  problem  statement  is  restrictive  in  the 
sense  that  uncertainties  in  both  the  control  and  observation  matrices  are 
not  permitted  within  the  same  feedback  loop.  Although  it  is  indeed  possible 
to  permit  such  simultaneous  uncertainties,  the  development  is  considerably 
more  complex  and  hence  is  outside  the  scope  of  this  paper. 

Remark  3.4.  The  cost  functional  (3.6)  is  identical  to  the  LQG 
criterion  (usually  stated  in  terms  of  an  averaged  integral)  with  the 
exception  of  the  supremum  for  evaluating  worst  case  over  U. 
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4. 


« 


Sufficient  Conditions  for  Robust  Stability  and  Performance 

In  practice,  steady-state  performance  is  only  of  interest  when  the 
closed-loop  system  (3.7)  is  stable  over  U.  The  following  result,  which 
expresses  the  performance  in  terms  of  the  state  covariance,  is  immediate. 


Lemma  4.1.  Let  (D 


,D  ,E  . . E  )  be  given  and  suppose 

cr  cl  cs  6  rv 


cl* 

system  (3.7)  is  stable  for  all  variations  in  U.  Then 


the 


J  (D 


cl' 


>Dcr*Ecl . Ecs>  =  SUP  tr  Q  -R» 

cr  Ci  cs  u  Ah 


(4.1) 


where  Q  _  =  lim  E[x(t)x(t)^]  f  N*1  is  the  unique  solution  to 

Ak  t— «  o o- 


0  =  (A-ulA)Q  _  +  Q  -(.k+Ak)  +  V. 

Ak  Ak 


(4.2) 


Remark  4.1.  When  U  is  compact,  "sup”  in  (4.1)  can  be  replaced  by 


"max" . 


We  now  seek  upper  bounds  for  J(D . D  ,E . E  ).  Our 

cl  cr  cl  cs 

assumptions  allow  us  to  obtain  robust  stability  as  a  consequence  of  robust 
performance. 


m.xA  m  xA  m  xA 

Theorem  4.1.  Let  Q :  N11  x  R  x  . . x  R  r  r  x  R  x 


m  xA 

x  R  S  S  — *  S°  be  such  that 


AkQ  +  QAAT  <  Q{ Q.D  . D  ,E  .....  ,E  ) , 

-  cl  cr  cl  cs 


(/1A./SB, . Ab  ,4c, . Ac  )  €  u; 

1  r  1  s  — 


(4.3) 


(Q.D 


cl* 


m.xA  m  xA  mix^i  m 

,D  , E  . E  )  £  l/xR  1  x...xR  r  rxR  1  x...xR  S  S. 

cr  cl  cs  =  =  =  =  = 


( 


# 


I 


i 


i 
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B 


Furthermore,  for  given  (D  , . D  ,E  E  )  suppose  there  exists  Q  €  N ' 

'  cl  cr  cl  cs  — 

satisfying 


.  0  =  AQ  +  QA  ♦  fl(Q.Dcl . Dcr,Ecl . y  *  V. 


(4.4) 


“1/2  ~ 

and  suppose  the  pair  (V  ,A+4A)  is  detectable  for  all  variations  in  U. 
Then,  for  all  variations  in  U,  k+AA  is  asymptotically  stable. 


Q  -  <  Q. 
Aa 


(4.5) 


where  Q^“  satisfies  (4.2),  and 


J (D  , . , . ,D  ,E  * , . . . ,E  )  <  tr  QR. 
cl  cr  cl  cs  — 


Proof.  For  all  variations  in  U,  (4.4)  is  equivalent  to 


(4.6) 


0  =  (A+4A)Q  +  Q(A-*4A)T  +  0(Q,D . ,D  ,  E  , . . .  ,E  ,AA )  +  V,  (4.7) 

cl  cr  cl  cs 


where 


0(0.0, . D  , E  E  ,AA)  =  fi( Q.D  . D  ,E  . E  )  -  (4AQ+Q4AT)  . 

cl  cr  cl  cs  cl  cr  cl  cs 

“1/2  “ 

Note  that  by  (4.3),  0(*)  >  0  for  all  variations  in  U.  Since  (V  ,A-hdA)  is 

detectable  for  all  variations  in  U,  it  follows  from  Theorem  3.6  of  [12]  that 

~  -  1  /  2  ”  " 

( [V+#(Q,D  . D  ,E  E  ,4A)]  ,A+4A)  is  detectable  for  all 

cl  cr  cl  cs  _  ~ 

variations  in  U.  Hence  Lemma  12.2  of  [12]  implies  A+4A  is  asymptotically 
stable  for  all  variations  in  U.  Next,  subtracting  (4.2)  from  (4.7)  yields 

o  =  (a-*4a)  (Q-Q  _)  +  (Q-Q  -)  (A+4A)T  +  0(Q,D  ...... D  ,E  . E  ,AA) , 

Aa  Aa  cl  cr  cl 

or,  equivalently,  (since  A+4A  is  asymptotically  stable) 
oo  ~  ^ 


Q  -  0  -  =  f  e(A+4A)t0(Q.D  . D  ,E  . E  ,4A)e 

J  cl  cr  cl  cs 


“  (a+4a)  t 


dt  >  0, 
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which  implies  (4.5).  Finally,  (4.5)  and  (4.1)  yield  (4.6).  Cl] 


Remark  4.2.  If  V  is  positive  definite  then  the  detectability 
hypothesis  of  Theorem  4.1  is  automatically  satisfied. 


5.  Uncertainty  Structure  and  the  Quadratic  Lyapunov  Bound 


The  uncertainty  set  U  is  assumed  to  be  of  the  form 


{(4A,4b  ....  »4b  ,4C, . 4C  ): 

I  r  1  s 


^  =  . .  (5.1) 


:j*2Xv  . .  Eak/oki  »• 


where,  for  k=*l, . . .  ,p:  (A^.B^ 


,B  ,  , C,, . C  ,  )  are  fixed  matrices 

rk  Ik  sk 


denoting  the  structure  of  the  parametric  uncertainty;  is  a  given 
uncertainty  bound;  and  cr^  is  an  uncertain  parameter.  Note  that  the 
uncertain  parameters  (X^  are  assumed  to  lie  in  a  specified  ellipsoidal  region 
in  R^.  The  closed-loop  system  thus  has  structured  uncertainty  of  the  form 


*k  •  £Vk- 


(5.2) 


where 


\ 4  *k +  £BaDcA  *  EVcj^k-  k=1 . . 

i=i  j=i 


(5.3) 
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To  obtain  explicit  gain  expressions  for  (D^,  •  •  •  ,Dcr*^ci . Ecs) 

we  assume  that,  for  each  k£  at  most  one  of  the  matrices 

^lk’  ’  *  *  ’^rk’^lk’ ' ' '  ’ *^sk  nonzero‘  Note  that  this  assumption  does  not 
preclude  the  treatment  of  uncertainties  in  the  input  and  output  matrices. 

It  requires  only  that  such  uncertainties  be  modeled  as  uncorrelated. 

Given  the  structure  of  U  defined  by  (5.1),  the  bound  satisfying 
(A. 3)  can  now  be  specified.  In  the  following  result  Q  denotes  an  arbitrary 
element  of  if1,  not  necessarily  a  solution  of  (4.4). 

Proposition  5.1.  Let  a  be  an  arbitrary  positive  scalar.  Then  the 

function 


£(Q,Dcl,....Dcr.Ecl,...,Ecg)  _  qtQ  +  O' 

k=l 


(5.4) 


satisfies  (4.3)  with  U  given  by  (5.1). 


Proof.  Note  that 


0  < 

k=l 


.1/2, 


„l/2_ 


1/2,7  i  T 


P  P  P 

-  -  IX 

k=l  k=l  k=l 


which  yields  (4.3)  .!ID 


Remark  5.1.  Note  that  the  bound  Q  given  by  (5.4)  consists  of  two 
distinct  terms.  The  first  term  OfQ  can  be  thought  of  as  arising  from  an 
exponential  time  weighting  of  the  cost,  or,  equivalently,  from  a  uniform 
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p 

right  shift  of  the  open-loop  dynamics  ( [1] ) .  The  second  term  a  \Q\ 

k=l 

arises  naturally  from  a  multiplicative  white  noise  model  ([3,4]).  Such 
interpretations  have  no  bearing  on  the  results  obtained  here  since  only  the 
bound  Q  defined  by  (5.4)  is  required.  Note  that  the  bound  is  valid  for  all 
positive  a. 

Rema rk  5.2.  The  conservatism  of  the  bound  (5.4)  is  difficult  to 

predict  for  two  reasons.  First,  the  overbounding  (4.3)  holds  with  respect 

to  the  partial  ordering  of  the  nonnegative-definite  matrices  for  which  no 

scalar  measure  of  conservatism  is  available.  And,  second,  the  bound  (4.3) 

is  required  to  hold  for  all  nonnegative-definite  matrices  Q  and  feedback 

gains  (D^  , . .  .D^.E^,  •  •  •  »Ecg)  *  '^ie  conservatism  will  thus  depend  upon  the 

actual  values  of  Q,  D  ,,...,D  ,E  ,,...,E  determined  by  solving  (4.4). 

cl  cr  cl  cs  jo 

6.  The  Auxiliary  Minimization  Problem  and  Necessary  Conditions  for 
Optimality 


Rather  than  minimizing  the  actual  cost  (3.6),  we  shall  consider  the 
upper  bound  (4.6).  This  leads  to  the  following  problem. 

Auxiliary  Minimization  Problem.  Determine 

(Q,D  .tool*  ,E  . E  )  which  minimizes 

cl  cr  cl  cs 


J (Q*D  - » • • • » ^  » E  - 1 • • • 9 E  )  —  tr  QR 

—  cl  cr  cl  cs 


(6.1) 


subject  to 


Q€Nn,  (6.2) 

P 

0  =  lefi  +  QA£  +  £yAQAk  +  V  (6.3) 

k=l 

and 


t 
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(6.4) 


(v1/2,a+4a) 


is  detectable  for  all  variations  in  U. 


The  relationship  between  the  Auxiliary  Minimization  Problem  and  the 
Robust  Stability  and  Performance  Problem  is  straightforward  as  shown  by  the 
following  observation. 


Proposition  6.1.  If  (Q,D  ,,....D  ,E . E  )  satisfies 

- - ~ — = -  cl  cr  cl  cs 


(6. 2) -(6.4)  then  A+dA  is  asymptotically  stable  for  all  variations  in  U,  and 


J(Dcl*-***Dcr’Ecl*-* 


,E  ) 
cs 


<  J (Q,D  , . . . ,D  ,E  , . . . ,E  )  . 
—  —  cl  cr  cl  cs 


(6.5) 


Proof.  With  Q  given  by  (5.4),  Proposition  5.1  implies  that  (4.3) 
is  satisfied.  Since  the  hypotheses  of  Theorem  4.1  are  satisfied,  robust 
stability  with  performance  bound  (4.6)  is  guaranteed.  Note  that  with 
definition  (6.1),  (6.5)  is  merely  a  restatement  of  (4.6).0 


The  derivation  of  the  necessary  conditions  for  the  Auxiliary 

Minimization  Problem  is  based  upon  the  Fritz  John  form  of  the  Lagrange 

multiplier  theorem.*  Rigorous  application  of  this  technique  requires  that 

(Q,D  . D  ,E  . . E  )  be  restricted  to  the  open  set 

cl  cr  cl  cs 

S  =  {(Q,D  ,  ...,D  ,E  . . E  ):  Q  € P°  and  A  is  asymptotically  stable], 

—  cl  cr  cl  cs  =  — 


where 


+ 


2>A®v 


k=l 


*The  Kuhn-Tucker  theorem  requires  a  priori  verification  of  a  constraint 
qualification  which  is  impossible  to  confirm  in  the  present  context.  The 
Fritz  John  version  is  less  restrictive  and  hence  more  suitable  in  the 
present  context. 


The  requirement  (Q,D  D  ,E  . . E  )  €  S  implies  that  Q  and  its 

cl  cr  cl  cs  - 

nonnegative-definite  dual  P  are  unique  solutions  of  the  modified  Lyapunov 
equations  (6.3)  and 


P 

0  =  A^P  +  PA*  +  +  *- 

k=l 


(6.6) 


An  additional  technical  requirement  is  that  (Q,D . D  ,E . E  )  be 

cl  cr  cl  cs 

confined  to  the  set 

S+  =  {(Q.D  .....D  E  .....E  )  €  S:  C  QCT  >  0.  i=l,...,r, 

-  cl  crcl  cs  —  i  i 


and  B^PB^  >  0»  j=l,...,s) 


The  positive  definiteness  conditions  in  the  definition  of  S  hold  when 
and  B.  have  full  row  and  column  rank,  respectively,  and  Q  and  P  are  positive 
definite.  As  can  be  seen  from  the  proof  of  Theorem  6.1  these  conditions 

A 

imply  the  existence  of  the  projections  t\  and  corresponding  to  the  two 
distinct  types  of  feedback  loops.  Note  that  S+  is  open. 


Remark  6.1.  As  pointed  out  in  Remark  3.1,  the  set  may  be  empty 
in  which  case,  of  course,  our  results  do  not  apply.  As  will  be  seen, 
however,  our  approach  does  not  require  explicit  verification  that  £>  is 
nonempty  since  robust  stability  is  obtained  as  a  consequence  of  robust 
performance. 

Remark  6.2.  As  will  be  seen,  the  constraint 

(Q.D  ,.-..»D  ,E  ,,...,E  )  f  S  need  not  be  verified  in  practice  and  is  not 

cl  cr  cl  cs  - 

required  for  either  robust  stability  or  robust  performance  since  Proposition 
6.1  shows  that  only  (6.2)-(6.4)  are  needed.  Rather,  the  set  S  constitutes 
sufficient  conditions  under  which  the  Lagrange  multiplier  technique  is 
applicable  to  the  Auxiliary  Minimization  Problem.  Specifically,  the 
condition  Q  >  0  replaces  (6.2)  by  an  open  set  constraint,  while  the 
asymptotic  stability  of  A  serves  as  a  normality  condition  which  further 
implies  that  the  dual  P  of  Q  is  nonnegative  definite. 
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Necessary  conditions  for  the  Auxiliary  Minimization  Problem  can  now 
be  obtained. 


Theorem  6.1.  If  (Q,D  ,E  . , . . .  ,E  )  (  S  solves  the 

-  cl  cr  cl  cs 


Auxiliary  Minimization  Problem  with  U  given  by  (5.1)  then  there  exists 

"cs 


P  €  N11  such  that  D  ^, . . . ,D  ,E  ^, . . . ,Ert^  are  given  by 


-1  ~T  '  -1 

D  .  =  -R  TP  .QC:(C.QCT)  ,  i=l,...,r. 

ex  ax  ai  x  l  i 


~T  *  —1 “T  -1 

E  .  =  -(BTPB.)  BTPQ  .V  T,  j=l,...,s, 
cj  3  1  J  aj  aj  J 


(6.7) 

(6.8) 


and  such  that  Q,  P  satisfy 


0  =  (Aq r'S"'' B.R  *P  .t.)Q  +  Q(Aa-V B.R_1P  .r. 
^  /_-/  x  ai  ax  x  ^  /-  j  i  ai  ai  i 


T 

)  +  V 


i=l 


i=l 


^k(VZlBii\lP.iTi)Q(VZBaRIiPaiTi 


)  (6.9) 


k=l  i=l 


i=l 


-  V'' Q  .V  1qT.  +  r.  Q  .V  1QT.tT  . 
Z—rfaj  aj  aj  3i  aj  aj  aj  ji 

j=l  j=l 


0  = 


(Aqt/  ‘ r. Q  .V  1C.)TP  +  P(Aa->  r.Q  .V  *C.)  +  R 
l—J  j  aj  a]  J  “  C-J  j  aj  aj  J  c 

j=l  j=l 


k=i  j=i  j=i 


)  (6.10) 


L.  L 

E„T  -1„  V''  T  T  -1„ 

P  .R  .P  .  +  >  T. ,P  .R  .P  .T. 
ax  ax  ax  Z— ^  xl  ax  ax  ax  xi 


i=l 


i=l 


where 
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r.  =  QCT(C.QCT)'1C., 

1  111  1 

A 

rii  = 

r.  -  I  . 
i  n 

1=  1»  •  •  •  » 

(6.11) 

;d 1 

A 

Tji  = 

;j  -  In- 

J  —  l i  * • • i s « 

(6.12) 

Furthermore,  the  auxiliary  cost  is  given  by 


J(Q.Dcl. .. 


,D  , E  . ■ • 
cr  cl 


,E  ) 
cs 


tr[Q(R  +Y^tTPT.r“1R.R  Ip  .  r.-2R  .R  *P  ,r.)]. 
o  /  -■  1  ai  ai  1  ai  ai  r  01  ai  ai  r 

i=l 

(6.13) 


Conversely,  if  there  exist  Q,  P  €  if1  satisfying  (6.9)  and  (6.10)  then  Q 

satisfies  (6.3)  with  (D^ . ^cr*^cl’ *  ‘  ’  *^cs^  8iven  by  (6.7)  and  (6.8),  and 

J (Q,D  . , . . . ,D  ,E  -,...,E  )  is  given  by  (6.13). 

—  cl  cr  cl  cs 

Proof.  To  optimize  (6.1)  over  the  open  set  S,  where 

S=  KQ.Dcl . Dcr,Ecr'",Ecs)  £  -+:  iS  satisfied** 

subject  to  the  constraint  (6.3),  form  the  Lagrangian 

P 

L(Q,D . Dcr*Ecl . Ecs)  *  tr^QR  +  (AQ+QAT+^ Y^QA^+V)?]  , 

k=l 

where  the  Lagrange  multipliers  X  >  0  and  P  €  R1^11  are  not  both  zero.  Setting 
dL/dQ  =  0,  X  =  0  implies  P  =  0  since  A  is  asymptotically  stable.  Hence, 
without  loss  of  generality  set  X  =  1.  Thus  the  stationarity  conditions  are 
given  by 


^  =  AaP  +  PAa+  £VkPAk  +  R  =  °' 


=  R  .D  ,C.QCT  +  P  .QCT  =  0,  i=l.  • 
SD  .  ai  ci  1  i  ai  i 
ci 


~~  =  btpb.e  .V  .  +  btpq  .  =  0.  j=l,. 

dE^  ]  jcjaj  J  aj 


(6.14) 

(6.15) 

(6.16) 
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Since  (Q,D  D  ,E  E  )fS  ,  C.QC7  and  B7PB .  are  invertible  and 

cl  crcl  cs-  11  jj 

hence  (6.15)  and  (6.16)  imply  (6.7)  and  (6-.8).  Finally,  (6.9)  and  (6.10) 
are  equivalent  to  (6.3)  and  (6.6).  ED 

Rema rk  6.3.  Several  special  cases  can  be  recovered  formally  from 

Theorem  6.1.  For  example,  when  the  control  weighting  is  nonsingular  and  the 

measurement  noise  is  zero,  i.e.,  when  u^  and  y^  are  absent  for  i=l . . 

delete  (6.8)  and  set  r,  =  0  in  (6.9).  In  this  case  the  last  two  terms  in 

3 

(6.9)  can  be  deleted.  Deleting  also  the  uncertainty  terms  A^,  B^, 
yields  the  results  of  [10]  with  the  added  features  of  correlated 
plant/measurement  noise  (V^)  and  cross  weighting  (R^J  .  Furthermore, 
assuming  a  centralized  structure  for  the  static  controller,  i.e.,  r=l, 
yields  the  usual  static  output  feedback  result  ([8,9]). 


7.  Sufficient  Conditions  for  Robust  Stability  and  Performance 


We  now  combine  Proposition  6.1  and  Theorem  6.1  to  obtain  sufficient 
conditions  for  robust  stability  and  performance. 

Theorem  7.1.  Suppose  there  exist  Q,  P  <  N*1  satisfying  (6.9)  and 
“1/2  “ 

(6.10)  and  suppose  that  (V  ,A+^A)  is  detectable  for  all  variations  in  U 

with  (D  . D  , E  , . E  )  given  by  (6.6)  and  (6.7)  and  U  given  by 

cl  cr  cl  cs  —  _  _ 

(5.1).  Then,  with  (D  D  ,E  E  )  given  by  (6.6)  and  (6.7),  A+^A 

cl  cr  cl  cs 

is  asymptotically  stable  for  all  variations  in  U,  and  the  performance  of  the 
closed-loop  system  satisfies  the  bound 


J  (D . ,D  ,  E . E  )  <  tr[Q(R  +VtTPT.R  1R.R  *P  .r.-2R  .R  *P  .t.)], 

cl  cr  cl  cs  —  o  i—i  x  ax  ai  i  ai  ai  x  oi  ai  ax  i 

i=l 

(7.1) 


Proof.  The  converse  of  Theorem  6.1  shows  that  Q  satisfies  (6.3) 


with  (D 


'  »D  »E  i » • 
cr  cl 


,,E  )  given  by  (6.7)  and  (6.8).  Hence,  with  the 

cs 


detectability  assumption  (6. A),  Proposition  6.1  implies  robust  stability  and 
performance.  ED 
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Remark  7.1.  The  application  of  Theorem  7.1  in  practice  requires 
1)  numerical  solution  of  (6.9)  and  (6.10),  and  2)  verification  of  the 
detectability  hypothesis.  No  other  assumptions  need  be  verified  in  applying 
this  result. 


8.  Concluding  Remarks 

We  have  developed  a  theory  of  robust  decentralized  output  feedback 
via  static  control.  The  development  permits  the  treatment  of  noisy  and 
nonnoisy  measurements,  weighted  and  unweighted  controls,  and  structured 
real-valued  parameter  uncertainties  in  the  plant  matrices.  The  theory 
provides  a  robustif ication  of  results  given  in  [8-10]  for  both  centralized 
and  decentralized  optimal  output  feedback.  The  theory  is  constructive  in 
nature  rather  than  existential.  Specifically,  the  main  result.  Theorem  7.1, 
involves  a  coupled  pair  of  modified  Riccati  equations  (6.9),  (6.10)  whose 
solutions,  when  they  exist,  are  used  to  explicitly  construct  feedback  gains 
(6.7),  (6.8)  which  are  guaranteed  to  provide  both  robust  stability  and 
performance.  Future  research  is  required  for  evaluating  the 
conservativeness  of  the  theory.  The  numerical  algorithms  developed  in  [101 
provide  a  starting  point  in  this  regard. 
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